-- Logs begin at Wed 2022-06-29 11:53:04 UTC, end at Wed 2022-06-29 12:58:13 UTC. -- Jun 29 12:24:51.471469 dv-cinder-812685-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 29 12:24:51.480804 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 29 12:24:51.482781 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 29 12:24:51 2022] *** Jun 29 12:24:51.482781 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 29 12:24:51.482781 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 29 12:24:51.482781 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: nodename: dv-cinder-812685-12-iscsi Jun 29 12:24:51.482781 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: machine: x86_64 Jun 29 12:24:51.482781 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: clock source: unix Jun 29 12:24:51.482781 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: pcre jit disabled Jun 29 12:24:51.482781 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: detected number of CPU cores: 4 Jun 29 12:24:51.482781 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: current working directory: / Jun 29 12:24:51.482781 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: detected binary path: /usr/bin/uwsgi-core Jun 29 12:24:51.483486 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: your processes number limit is 47680 Jun 29 12:24:51.483486 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: your memory page size is 4096 bytes Jun 29 12:24:51.483486 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: detected max file descriptor number: 2048 Jun 29 12:24:51.483486 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: lock engine: pthread robust mutexes Jun 29 12:24:51.483486 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: thunder lock: enabled Jun 29 12:24:51.483486 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 29 12:24:51.483486 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 29 12:24:51.526328 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: Python main interpreter initialized at 0x55d0160a99c0 Jun 29 12:24:51.526328 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: python threads support enabled Jun 29 12:24:51.526328 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: your server socket listen backlog is limited to 100 connections Jun 29 12:24:51.526328 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: your mercy for graceful operations on workers is 90 seconds Jun 29 12:24:51.526703 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: mapped 403077 bytes (393 KB) for 2 cores Jun 29 12:24:51.526780 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: *** Operational MODE: preforking *** Jun 29 12:24:51.526996 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: *** uWSGI is running in multiple interpreter mode *** Jun 29 12:24:51.526996 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: spawned uWSGI master process (pid: 103171) Jun 29 12:24:51.527173 dv-cinder-812685-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 29 12:24:51.529857 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: spawned uWSGI worker 1 (pid: 103172, cores: 1) Jun 29 12:24:51.529857 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: spawned uWSGI worker 2 (pid: 103173, cores: 1) Jun 29 12:24:51.529857 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 29 12:24:52.183067 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 29 12:24:52.188852 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 29 12:24:53.314127 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 12:24:53.314127 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: from cryptography.utils import int_from_bytes Jun 29 12:24:53.314845 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 12:24:53.314845 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: from cryptography.utils import int_from_bytes Jun 29 12:24:53.318095 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 12:24:53.318095 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: from cryptography.utils import int_from_bytes Jun 29 12:24:53.318569 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 12:24:53.318569 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: from cryptography.utils import int_from_bytes Jun 29 12:24:55.797402 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 12:24:55.797989 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 12:24:55.798164 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 12:24:55.798541 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 12:24:55.798744 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 12:24:55.799094 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 12:24:55.799177 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 12:24:55.799278 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.799474 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.799566 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 12:24:55.799791 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.799907 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 12:24:55.800109 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.800712 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 12:24:55.801016 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.801110 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.801399 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.801483 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.801718 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.801813 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.802036 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.802129 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.802357 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.802476 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.802647 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.802735 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.802961 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.803047 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.803281 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-12-iscsi {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.803377 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.803599 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.803693 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.803890 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.803975 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.804198 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.804292 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.804509 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.804606 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-12-iscsi {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.804808 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.804903 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.805126 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.805212 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.805427 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.805520 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.805746 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.805916 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.806055 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.806355 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.806501 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.806686 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.806807 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.806993 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.807201 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.807398 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.807550 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.807652 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.807782 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.807913 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.808087 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.808227 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.808425 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.808554 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.808740 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.808827 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.809049 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.809135 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.809370 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.809504 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-12-iscsi {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.809680 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.809817 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.810005 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.810170 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.810322 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.810456 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.810745 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-12-iscsi {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.810862 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.811063 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.811157 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.811377 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.811555 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.811692 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.811780 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.812068 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.812164 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.812370 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.812457 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.812689 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.812777 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.813006 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.813092 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.813320 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.813420 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.813634 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.813726 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.813929 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.814014 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.814239 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.814404 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.814607 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.814833 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.814921 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.815152 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.815240 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.815461 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.815599 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.815793 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.815914 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.816682 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.816769 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.816992 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.817138 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.817301 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.817462 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.817550 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.817784 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.817880 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.818105 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.818196 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.818358 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.818482 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.818633 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.818804 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.818950 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.819060 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.819268 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.819365 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.819572 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.819660 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.819877 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.819971 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.820180 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.820335 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.820483 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.820570 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.820783 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.820880 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.821086 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.821173 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.821387 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.821480 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.821687 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.821772 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.821991 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.822077 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.822300 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.822394 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.822640 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.822727 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.822943 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.823032 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.823258 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.823345 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.823575 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.823742 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.823900 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.824044 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.824190 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.824336 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.824474 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.824628 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.824774 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.824924 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.825161 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.825327 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.825468 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.825634 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.825781 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.825992 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.826155 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.826312 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.826498 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.826656 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.826806 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.826946 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.827090 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.827248 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.827393 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.827554 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.827700 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.827857 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.828004 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.828151 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.828318 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.828468 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.828593 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.828678 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.828757 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.828896 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.828991 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.829079 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.829264 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.829567 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.829654 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.829866 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.830153 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.830241 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.830478 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.830694 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.830780 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.831020 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.831121 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.831334 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.831448 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.831904 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.832019 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.832358 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.832467 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.832667 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.832754 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.832973 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.833062 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.833291 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.833376 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.833604 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.833691 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.833910 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.833995 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.834216 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.834304 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.834548 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.834656 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.834852 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.834939 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.835175 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.835264 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.835481 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.835770 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.835864 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.836089 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.836183 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.836392 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.836479 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.836694 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.836781 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.837006 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.837102 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.837308 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.837402 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.837660 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.837747 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.837975 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.838140 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.838274 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.838364 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.838600 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.838689 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.838915 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.839015 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.839219 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.839314 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.839520 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.839614 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.839821 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.839916 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.840122 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.840209 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.840421 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.840557 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.840722 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.840810 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.841022 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.841114 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.841321 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.841420 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.841624 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.841755 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.841921 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.842014 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.842227 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.842314 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.842559 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.842696 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.842861 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.842948 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.843162 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.843248 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.843473 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.843561 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.843794 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.843880 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.844117 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.844216 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.844432 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.844526 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.844741 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.844827 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.845071 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.845174 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.845402 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.845714 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:24:55.845800 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.846024 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.846339 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.846458 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.846686 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.847029 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.847200 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.847601 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.847854 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.847954 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.848035 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.848223 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.848310 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.848540 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.848764 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.848859 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.849166 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.849366 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.849481 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.849797 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.849959 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.850105 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.850452 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.850591 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.850763 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.851019 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.851284 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.851420 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.851592 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.851895 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.851982 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.852256 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.852498 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.852585 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.852872 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.853095 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.853188 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.853487 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.853703 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.853791 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.854086 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.854325 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.854437 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.854740 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.854884 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.855223 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.855311 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.855557 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.855642 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.855869 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.855964 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.856181 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.856268 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.856490 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.856577 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.856798 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.856885 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.857308 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.857442 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.857644 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.857957 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.858066 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.858264 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.858359 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.858597 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.858686 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.858910 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.859022 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.859218 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.859352 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.859527 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.859673 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.859834 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.860052 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.860331 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.860633 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.860774 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.860936 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.861240 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.861336 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.861541 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.861855 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.861942 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.862180 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.862274 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.862505 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.862595 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.863505 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.863614 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.863892 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.863991 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.864201 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.864297 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.864509 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.864598 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.864817 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.864913 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.865119 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.865205 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.865427 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.865515 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.865735 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.865823 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.866037 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.866171 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.866357 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.866474 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.866698 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.866787 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.867001 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.867088 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.867319 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.867406 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.867624 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.867714 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.867928 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.868016 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.868238 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.868332 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.868543 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.868629 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.868850 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.868936 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.869160 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.869255 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.869467 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.869554 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.869787 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.869874 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.870097 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.870194 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.870404 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.870544 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.870753 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.870887 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.871068 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.871163 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.871370 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.871462 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.871682 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.871767 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.871998 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.872086 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.872310 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.872395 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.872611 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.872705 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.872918 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.873014 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.873217 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.873305 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.873518 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.873613 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.873817 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.873905 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.874122 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.874215 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.874468 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.874558 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.874784 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.874873 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.875102 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.875189 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.875413 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.875512 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.875715 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.875803 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.876030 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.876116 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.876333 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.876431 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.876639 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.876726 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.876937 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.877024 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.877235 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.877337 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.877572 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.877659 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.877873 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.877959 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.878210 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.878334 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.879149 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.879241 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.879512 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.879597 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.879834 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.879923 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.880146 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.880241 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.880459 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.880546 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.880767 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.880862 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.881076 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.881165 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.881384 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.881477 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.881691 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.881793 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.882004 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.882093 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.882310 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.882404 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.882651 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.882743 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.882959 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.883047 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.883279 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.883374 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.883589 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.883684 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.883895 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.883981 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.884193 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.884287 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.884500 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.884586 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.884833 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.884917 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.885144 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.885237 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.885462 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.885556 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.885778 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.885864 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.886084 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.886179 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.886393 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.886527 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.886724 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.886812 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.887032 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.887120 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.887338 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.887431 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.887645 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.887739 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.887958 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.888046 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.888265 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.888351 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.888579 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.888666 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.888886 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.888974 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.889204 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.889290 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.889510 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.889596 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.889822 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.889909 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.890121 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.890207 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.890446 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.890537 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.890767 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.890855 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.891088 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.891174 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.891393 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.891525 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.891700 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.891795 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.892015 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.892102 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.892322 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.892418 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.892628 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.892715 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.892936 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.893022 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.893239 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.893335 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.893538 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.893631 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.893843 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.893950 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.894207 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.894371 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.894537 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.894742 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.894840 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.895062 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.895158 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.895389 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.895477 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.895706 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.895792 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.896006 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.896102 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.896309 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.896395 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.896620 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.896721 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.896939 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.897051 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.897243 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.897580 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.897812 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.897898 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.898130 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.898226 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.898462 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.898565 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.898753 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.898848 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.899071 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.899167 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.899377 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.899464 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.899679 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.899766 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.899981 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.900069 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.900284 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.900370 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.900595 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.900687 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.900908 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.901003 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.901207 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.901294 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.901521 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.901655 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.901832 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.901919 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.902135 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.902220 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.902468 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.902573 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.902780 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.902866 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.903086 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.903179 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.903393 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.903487 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.903701 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.903786 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.904009 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.904094 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.904318 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.904418 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.904627 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.904723 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.904937 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.905024 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.905244 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.905338 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.905552 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.905640 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.905856 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.905947 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.906166 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.906266 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.906492 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.906599 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.906799 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.906891 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.907104 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.907190 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.907416 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.907501 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.907749 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.907980 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.908076 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.908310 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.908404 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.908623 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.908718 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.908938 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.909041 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.909255 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.909341 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.909625 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.909753 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.909956 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.910095 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.910279 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.910443 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.910655 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.910760 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.910959 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.911069 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.911266 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.911385 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.911569 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.911699 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.911874 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.912015 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.912184 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.912330 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.912486 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.912654 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.912789 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.912969 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.913090 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.913284 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.913397 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.913597 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.913683 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.913905 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.913993 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.914221 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.914308 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.914573 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.914662 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.914887 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.915141 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.915235 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.915482 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.915568 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.915782 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.915877 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.916100 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.916187 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.916411 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.916498 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.916711 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.916798 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.917010 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.917096 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.917312 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.917398 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.917648 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.917736 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.917949 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.918045 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.918280 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.918367 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.918627 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.918794 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.918940 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.919028 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.919253 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.919338 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.919555 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.919657 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.919861 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.919952 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.920163 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.920249 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.920464 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.920567 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.920765 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.920853 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.921070 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.921156 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.921373 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.921459 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.921673 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.921760 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.921980 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.922067 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.922284 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.922448 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.922611 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.922713 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.922916 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.923003 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.923215 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.923304 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.923521 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.923615 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.923821 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.923914 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.924124 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.924217 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.924429 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.924515 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.924728 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.924823 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.925027 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.925629 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.925870 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.926011 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.926179 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.926507 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.926598 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.926823 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.926921 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.927123 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.927210 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.927438 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.927527 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.927741 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.927828 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.928043 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.928138 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.928347 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.928435 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.928654 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.928739 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.928957 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.929055 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.929258 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.929344 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.929563 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.929655 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.929874 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.930014 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.930175 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.930270 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.930507 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.930595 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.930814 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.930909 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.931114 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.931201 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.931414 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.931558 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.931721 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.931816 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.932036 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.932121 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.932346 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.932431 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.932646 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.932733 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.932951 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.933038 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.933252 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.933340 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.933552 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.933640 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.933851 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.933946 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.934154 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.934248 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.934474 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.934566 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.934779 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.934866 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.935080 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.935179 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.935381 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.935468 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.935681 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.935768 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.935993 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.936086 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.936296 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.936389 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.936595 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.936682 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.936901 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.936996 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.937201 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.937288 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.937514 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.937608 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.937823 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.937918 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.938136 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.938230 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.938461 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.938562 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.938774 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.938870 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.939087 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.939181 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.939394 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.939480 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.939704 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.939793 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.940013 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.940100 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.940313 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.940400 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.940618 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.940704 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.941019 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.941109 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.941342 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.941467 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.941640 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.941729 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.941940 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.942026 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.942256 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.942350 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.942586 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.942674 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.942894 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.942992 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.943201 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.943296 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.943518 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.943605 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.943827 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.943922 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.944129 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.944223 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.944433 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.944519 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.944738 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.944823 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.945041 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.945142 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.945345 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.945440 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.945653 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.945746 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.945959 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.946060 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.946266 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.946354 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.946601 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.946690 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.946910 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.947046 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.947216 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.947304 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.947518 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.947605 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.947824 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.947914 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.948128 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.948215 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.948429 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.948524 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.948741 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.948835 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.949047 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.949139 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.949347 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.949434 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.949650 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.949738 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.949948 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.950035 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.950253 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.950352 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.950573 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.950674 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.950918 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.951003 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.951253 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.951348 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.951563 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.951653 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.951874 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.951958 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.952181 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.952276 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.952487 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.952573 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.952795 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.952880 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.953101 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.953199 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.953402 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.953497 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.953714 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.953799 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.954028 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.954114 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.954340 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.954468 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.954678 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.954766 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.954989 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.955077 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.955295 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.955387 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.955602 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.955688 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.955908 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.955994 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.956206 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.956291 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.957065 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.957212 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.957371 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.957461 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.957685 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.957775 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.957983 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.958082 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.958294 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.958388 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.958627 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.958714 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.959024 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.959123 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.959325 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.959413 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.959659 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.959744 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.959968 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.960064 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.960281 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.960368 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.960595 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.960681 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.960912 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.961009 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.961227 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.961314 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.961526 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.961612 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.961835 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.961952 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.962140 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.962271 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.962487 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.962612 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.962806 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.962926 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.963113 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.963236 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.963425 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.963546 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.963726 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.963857 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.964043 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.964184 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.964363 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.964492 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.964671 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.964797 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.964987 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.965103 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.965400 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.965511 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.965719 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.965806 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.966026 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.966112 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.966344 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.966483 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.966690 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.966791 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.966999 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.967136 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.967301 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.967474 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.967597 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.967788 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.967898 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.968101 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.968188 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.968427 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.968506 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.968755 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.968842 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.969081 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.969168 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.969383 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.969470 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.969687 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.969776 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.969987 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.970075 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.970286 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.970458 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.970627 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.970727 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.970929 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.971017 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.971245 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.971340 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.971552 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.971638 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.971866 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.971952 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.972738 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.972879 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.973056 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.973147 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.973383 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.973478 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.973771 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.973868 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.974075 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.974163 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.974381 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.974488 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.974711 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.974802 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.975055 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.975143 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.975365 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.975451 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.975674 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.975763 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.975988 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.976075 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.976296 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.976382 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.976602 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.976689 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.976925 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.977012 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.977232 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.977374 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.977546 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.977642 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.977859 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.977948 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.978168 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.978264 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.978499 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.978591 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.978809 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.978897 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.979115 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.979212 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.979420 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.979508 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.979721 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.979817 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.980022 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.980120 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.980329 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.980417 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.980626 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.980715 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.980927 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.981023 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.981226 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.981314 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.981543 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.981630 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.981843 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.981939 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.982151 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.982246 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.982471 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.982572 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.982775 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.982863 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.983076 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.983163 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.983377 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.983463 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.983711 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.983800 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.984011 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.984105 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.984340 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.984427 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.984652 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.984740 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.984966 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.985054 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.985292 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.985391 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.985599 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.985685 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.985919 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.986006 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.986225 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.986319 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.986557 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.986664 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.986871 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.986958 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.987178 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.987273 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.987485 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.987579 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.987840 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.987949 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.988147 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.988281 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.988453 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.988541 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.988757 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.988846 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.989062 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.989151 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.989385 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.989472 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.989692 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.989923 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.990023 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.990250 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.990345 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.990587 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.990692 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.990899 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.991000 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.991209 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.991297 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.991519 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.991606 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.991830 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.991925 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.992138 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.992227 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.992447 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.992535 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.992755 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.992857 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.993062 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.993162 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.993383 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.993471 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.993702 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.993791 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.994019 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.994105 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.994338 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.994486 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.994673 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.994761 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.994983 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.995071 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.995294 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.995459 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.995604 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.995692 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.995919 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.996004 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.996232 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.996328 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.996541 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.996628 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.996853 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.996941 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.997167 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.997263 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.997476 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.997684 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.997772 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.998016 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.998113 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.998335 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.998439 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.998678 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.998767 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.998982 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.999080 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.999286 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.999374 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.999593 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.999680 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.999901 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:55.999997 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.000210 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.000296 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.000524 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.000611 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.000838 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.000933 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.001144 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.001230 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.001453 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.001541 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.001763 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.001852 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.002120 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.002267 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.002465 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.002612 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.002786 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.002940 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.003078 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.003281 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.003429 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.003602 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.003788 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.003916 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.004107 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.004228 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.004419 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.004548 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.004737 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.004852 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.005055 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.005149 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.005369 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.005466 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.005683 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.005770 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.005995 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.006086 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.006309 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.006405 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.006648 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.006735 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.006950 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.007039 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.007259 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.007346 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.007561 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.007686 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.007874 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.008084 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.008182 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.008426 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.008515 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.008739 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.008826 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.009060 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.009148 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.009381 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.009469 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.009695 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.009782 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.009998 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.010240 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.010327 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.010593 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.010683 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.010927 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.011025 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.011239 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.011327 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.011546 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.011641 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.011848 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.011944 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.012149 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.012238 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.012456 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.012543 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.012760 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.012849 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.013059 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.013154 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.013365 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.013453 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.013664 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.013753 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.013979 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.014066 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.014278 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.014364 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.014604 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.014700 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.014905 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.014992 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.015211 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.015298 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.015511 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.015600 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.015809 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.016043 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.016141 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.016393 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.016482 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.016700 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.016785 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.017002 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.017091 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.017309 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.017398 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.017610 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.017697 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.017917 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.018005 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.018216 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.018305 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.018543 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.018634 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.019405 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.019510 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.019722 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.019820 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.020115 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.020203 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.020429 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.020526 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.020743 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.020838 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.021061 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.021149 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.021373 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.021473 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.021683 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.021769 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.021992 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.022081 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.022566 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.022674 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.022900 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.022989 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.023213 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.023424 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.023516 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.023756 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.023845 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.024077 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.024164 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.024404 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.024500 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.024710 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.024796 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.025020 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.025106 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.025324 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.025417 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.025630 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.025718 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.025934 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.026021 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.026249 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.026343 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.026579 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.026682 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.026886 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.026975 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.027192 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.027287 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.027498 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.027583 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.027803 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.027899 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.028111 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.028208 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.028419 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.028508 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.028727 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.028822 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.029034 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.029130 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.029341 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.029429 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.029649 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.029736 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.029956 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.030045 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.030266 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.030353 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.030623 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.030725 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.030941 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.031029 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.031255 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.031472 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.031560 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.031817 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.031912 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.032142 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.032237 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.032459 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.032546 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.032769 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.032860 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.033075 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.033163 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.033389 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.033483 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.033697 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.033785 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.034015 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.034102 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.034319 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.034436 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.035210 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.035527 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.035617 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.035845 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.035940 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.036158 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.036255 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.036472 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.036562 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.036785 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.036874 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.037100 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.037188 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.037412 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.037502 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.037726 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.037822 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.038037 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.038124 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.038349 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.038472 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.038691 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.038796 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.039008 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.039097 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.039344 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.039430 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.039665 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.039765 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.039967 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.040054 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.040272 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.040367 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.040572 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.040661 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.040876 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.040964 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.041190 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.041277 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.041495 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.041592 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.041796 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.041886 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.042097 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.042192 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.042401 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.042508 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.042723 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.042861 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.043026 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.043131 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.043327 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.043457 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.043628 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.043775 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.043933 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.044100 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.044232 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.044426 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.044534 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.044741 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.044829 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.045067 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.045163 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.045394 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.045482 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.045700 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.045794 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.046005 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.046093 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.046305 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.046392 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.046632 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.046736 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.046932 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.047020 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.047234 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.047328 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.047585 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.047697 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.047868 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.047963 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.048198 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.048294 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.048504 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.048599 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.048816 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.048912 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.049122 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.049208 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.049433 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.049521 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.049737 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.049823 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.050040 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.050170 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.050390 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.050586 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.050780 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.050893 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.051117 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.051249 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.051429 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.051560 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.051743 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.051840 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.052056 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.052152 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.052363 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.052452 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.052670 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.052765 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.052978 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.053074 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.053286 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.053373 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.053593 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.053679 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.053900 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.054000 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.054209 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.054296 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.054539 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.054628 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.054849 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.054949 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.055157 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.055251 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.055466 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.055561 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.055774 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.055874 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.056101 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.056189 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.056412 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.056500 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.056718 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.056807 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.057031 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.057161 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.057337 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.057426 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.057651 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.057740 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.057962 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.058049 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.058273 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.058360 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.058619 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.058710 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.058937 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.059023 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.059246 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.059345 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.059569 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.059658 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.059882 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.059969 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.060199 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.060294 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.060516 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.060603 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.060832 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.060919 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.061146 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.061242 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.061464 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.061550 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.061776 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.061864 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.062081 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.062241 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.062325 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 12:24:56.062406 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.062748 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.063073 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.063398 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.063718 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.064034 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.064366 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.064680 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.064994 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.065313 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.065626 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.065985 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.066306 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.066656 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.066985 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.067316 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.067638 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.067966 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.068298 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.068650 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.068969 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.069316 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.069647 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.069968 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.070286 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.070624 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:24:56.070870 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 12:24:56.221873 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO dbcounter [None req-fc1005b5-2551-4c2d-9d14-f42c1ad27f46 None None] Registered counter for database nova_api Jun 29 12:24:56.228526 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO dbcounter [None req-99dc06c3-cbc8-41ac-84d5-0cf4cfd1d165 None None] Registered counter for database nova_api Jun 29 12:24:56.243353 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG oslo_db.sqlalchemy.engines [None req-fc1005b5-2551-4c2d-9d14-f42c1ad27f46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103172) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 12:24:56.248305 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG oslo_db.sqlalchemy.engines [None req-99dc06c3-cbc8-41ac-84d5-0cf4cfd1d165 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 12:24:56.250320 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writer thread running {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 12:24:56.255782 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writer thread running {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 12:24:56.306933 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.context [None req-fc1005b5-2551-4c2d-9d14-f42c1ad27f46 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),644b0361-1506-422f-bdf1-8cea2d80e866(cell1) {{(pid=103172) load_cells /opt/stack/nova/nova/context.py:464}} Jun 29 12:24:56.310795 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-fc1005b5-2551-4c2d-9d14-f42c1ad27f46 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:24:56.311408 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.context [None req-99dc06c3-cbc8-41ac-84d5-0cf4cfd1d165 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),644b0361-1506-422f-bdf1-8cea2d80e866(cell1) {{(pid=103173) load_cells /opt/stack/nova/nova/context.py:464}} Jun 29 12:24:56.312383 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-fc1005b5-2551-4c2d-9d14-f42c1ad27f46 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:24:56.313165 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-fc1005b5-2551-4c2d-9d14-f42c1ad27f46 None None] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:24:56.315137 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-fc1005b5-2551-4c2d-9d14-f42c1ad27f46 None None] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:24:56.315334 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-99dc06c3-cbc8-41ac-84d5-0cf4cfd1d165 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:24:56.317690 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO dbcounter [None req-fc1005b5-2551-4c2d-9d14-f42c1ad27f46 None None] Registered counter for database nova_cell0 Jun 29 12:24:56.317887 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-99dc06c3-cbc8-41ac-84d5-0cf4cfd1d165 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:24:56.318709 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-99dc06c3-cbc8-41ac-84d5-0cf4cfd1d165 None None] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:24:56.320657 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-99dc06c3-cbc8-41ac-84d5-0cf4cfd1d165 None None] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:24:56.322665 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO dbcounter [None req-99dc06c3-cbc8-41ac-84d5-0cf4cfd1d165 None None] Registered counter for database nova_cell0 Jun 29 12:24:56.323177 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO dbcounter [None req-fc1005b5-2551-4c2d-9d14-f42c1ad27f46 None None] Registered counter for database nova_cell1 Jun 29 12:24:56.328092 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO dbcounter [None req-99dc06c3-cbc8-41ac-84d5-0cf4cfd1d165 None None] Registered counter for database nova_cell1 Jun 29 12:24:56.330827 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG oslo_db.sqlalchemy.engines [None req-fc1005b5-2551-4c2d-9d14-f42c1ad27f46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103172) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 12:24:56.333100 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG oslo_db.sqlalchemy.engines [None req-fc1005b5-2551-4c2d-9d14-f42c1ad27f46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103172) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 12:24:56.335242 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG oslo_db.sqlalchemy.engines [None req-99dc06c3-cbc8-41ac-84d5-0cf4cfd1d165 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 12:24:56.338042 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writer thread running {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 12:24:56.340670 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writer thread running {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 12:24:56.341083 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writer thread running {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 12:24:56.341319 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG oslo_db.sqlalchemy.engines [None req-99dc06c3-cbc8-41ac-84d5-0cf4cfd1d165 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 12:24:56.482789 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writer thread running {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 12:24:56.485899 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO dbcounter [None req-fc1005b5-2551-4c2d-9d14-f42c1ad27f46 None None] Registered counter for database nova_cell0 Jun 29 12:24:56.492091 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO dbcounter [None req-99dc06c3-cbc8-41ac-84d5-0cf4cfd1d165 None None] Registered counter for database nova_cell0 Jun 29 12:24:56.493221 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG oslo_db.sqlalchemy.engines [None req-fc1005b5-2551-4c2d-9d14-f42c1ad27f46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103172) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 12:24:56.497434 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writer thread running {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 12:24:56.499045 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG oslo_db.sqlalchemy.engines [None req-99dc06c3-cbc8-41ac-84d5-0cf4cfd1d165 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 12:24:56.503415 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writer thread running {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 12:24:56.830919 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: WARNING keystonemiddleware.auth_token [None req-99dc06c3-cbc8-41ac-84d5-0cf4cfd1d165 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 12:24:56.833062 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: WARNING keystonemiddleware.auth_token [None req-fc1005b5-2551-4c2d-9d14-f42c1ad27f46 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 12:24:56.838743 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: WARNING keystonemiddleware.auth_token [None req-99dc06c3-cbc8-41ac-84d5-0cf4cfd1d165 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 12:24:56.840221 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: WARNING keystonemiddleware.auth_token [None req-fc1005b5-2551-4c2d-9d14-f42c1ad27f46 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 12:24:57.174100 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: WARNING keystonemiddleware.auth_token [None req-99dc06c3-cbc8-41ac-84d5-0cf4cfd1d165 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 12:24:57.180469 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: WARNING keystonemiddleware.auth_token [None req-99dc06c3-cbc8-41ac-84d5-0cf4cfd1d165 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 12:24:57.183566 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: WARNING keystonemiddleware.auth_token [None req-fc1005b5-2551-4c2d-9d14-f42c1ad27f46 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 12:24:57.185679 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d0160a99c0 pid: 103173 (default app) Jun 29 12:24:57.187732 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-99dc06c3-cbc8-41ac-84d5-0cf4cfd1d165 None None] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:24:57.188917 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-99dc06c3-cbc8-41ac-84d5-0cf4cfd1d165 None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001701 Jun 29 12:24:57.189596 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Wed Jun 29 12:24:57 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:24:57.189707 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: WARNING keystonemiddleware.auth_token [None req-fc1005b5-2551-4c2d-9d14-f42c1ad27f46 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 12:24:57.195299 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d0160a99c0 pid: 103172 (default app) Jun 29 12:26:12.857794 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-99dc06c3-cbc8-41ac-84d5-0cf4cfd1d165 None None] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:26:12.859601 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-99dc06c3-cbc8-41ac-84d5-0cf4cfd1d165 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002349 Jun 29 12:26:12.860097 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 12:26:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:26:12.876445 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writing DB stats nova_api:SELECT=3 {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:26:12.877713 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writing DB stats nova_cell1:SELECT=3 {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:26:12.878531 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writing DB stats nova_cell0:SELECT=3 {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:26:12.879394 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:26:13.310773 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-c61836f3-6077-4e31-a3dd-df1e37836d20 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:26:13.342280 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-c61836f3-6077-4e31-a3dd-df1e37836d20 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.474930 Jun 29 12:26:13.343160 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1291 bytes} [Wed Jun 29 12:26:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:26:15.430978 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-99dc06c3-cbc8-41ac-84d5-0cf4cfd1d165 None None] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:26:15.431981 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-99dc06c3-cbc8-41ac-84d5-0cf4cfd1d165 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 29 12:26:15.432375 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 12:26:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:26:15.493333 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-89526fdf-959e-47f9-b1aa-6664606cd59a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "id": "c1", "swap": 0}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:26:15.512113 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:26:15.512113 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: warnings.warn(msg) Jun 29 12:26:15.540393 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-89526fdf-959e-47f9-b1aa-6664606cd59a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102185 Jun 29 12:26:15.541163 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Jun 29 12:26:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 12:26:15.773378 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-57bd0eb6-6b0c-4393-93b4-84bf39a125fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:26:15.775906 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:26:15.775906 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: warnings.warn(msg) Jun 29 12:26:15.778727 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writing DB stats nova_api:SELECT=3 {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:26:15.779730 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writing DB stats nova_cell0:SELECT=3 {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:26:15.780642 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writing DB stats nova_cell1:SELECT=3 {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:26:15.781436 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:26:15.842996 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-57bd0eb6-6b0c-4393-93b4-84bf39a125fc admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.293058 Jun 29 12:26:15.843952 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1335 bytes} [Wed Jun 29 12:26:15 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:26:17.959867 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-89526fdf-959e-47f9-b1aa-6664606cd59a admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:26:17.961158 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-89526fdf-959e-47f9-b1aa-6664606cd59a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001908 Jun 29 12:26:17.962403 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 12:26:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:26:18.069277 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-945b10c5-19c5-4c78-84f8-444ecf1f46e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "ram": 512, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M"}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:26:18.087461 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:26:18.087461 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: warnings.warn(msg) Jun 29 12:26:18.106632 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-945b10c5-19c5-4c78-84f8-444ecf1f46e9 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.137853 Jun 29 12:26:18.107384 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Jun 29 12:26:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 12:26:18.119491 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-245a5720-60e6-4706-92da-eb6affb7cc60 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:26:18.120906 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:26:18.120906 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: warnings.warn(msg) Jun 29 12:26:18.158508 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-245a5720-60e6-4706-92da-eb6affb7cc60 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037834 Jun 29 12:26:18.158508 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1335 bytes} [Wed Jun 29 12:26:18 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:26:20.244475 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-945b10c5-19c5-4c78-84f8-444ecf1f46e9 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:26:20.245498 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-945b10c5-19c5-4c78-84f8-444ecf1f46e9 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 29 12:26:20.246141 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 12:26:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:26:20.306934 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-33f75e70-5376-4313-b604-ee847942b212 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d2", "ram": 1024, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:26:20.326922 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-33f75e70-5376-4313-b604-ee847942b212 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074650 Jun 29 12:26:20.327722 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Jun 29 12:26:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 12:26:20.339484 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-0beceb3b-f403-45d0-9e4a-6d8f0fda48d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:26:20.371291 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-0beceb3b-f403-45d0-9e4a-6d8f0fda48d8 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035384 Jun 29 12:26:20.372560 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1335 bytes} [Wed Jun 29 12:26:20 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:26:22.475922 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-33f75e70-5376-4313-b604-ee847942b212 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:26:22.476869 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-33f75e70-5376-4313-b604-ee847942b212 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 29 12:26:22.477262 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 12:26:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:26:22.536865 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-3256cebc-7e9f-4049-829b-7dde4655f769 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "id": "d3", "disk": 10}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:26:22.553428 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-3256cebc-7e9f-4049-829b-7dde4655f769 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070363 Jun 29 12:26:22.554065 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Jun 29 12:26:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 12:26:22.565962 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-74748ef4-d6b0-47ec-9c15-b3c477f6bc7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:26:22.588209 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-74748ef4-d6b0-47ec-9c15-b3c477f6bc7b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026104 Jun 29 12:26:22.588759 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1335 bytes} [Wed Jun 29 12:26:22 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:26:24.791076 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-3256cebc-7e9f-4049-829b-7dde4655f769 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:26:24.792181 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-3256cebc-7e9f-4049-829b-7dde4655f769 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001622 Jun 29 12:26:24.792651 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 12:26:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:26:24.850399 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-f7939b72-ffb6-4568-b598-575e188a38ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "id": "d4", "rxtx_factor": 1.0, "disk": 20, "swap": 0}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:26:24.867782 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-f7939b72-ffb6-4568-b598-575e188a38ed admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.068648 Jun 29 12:26:24.868371 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Jun 29 12:26:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 12:26:24.880790 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-9ce1ed12-b857-435c-b817-6bd0a242a0fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:26:24.903614 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-9ce1ed12-b857-435c-b817-6bd0a242a0fb admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026481 Jun 29 12:26:24.904119 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1335 bytes} [Wed Jun 29 12:26:24 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:26:27.039330 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-f7939b72-ffb6-4568-b598-575e188a38ed admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:26:27.040352 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-f7939b72-ffb6-4568-b598-575e188a38ed admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 29 12:26:27.040755 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 12:26:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:26:27.107593 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-56b41e71-db4a-4d7c-9f19-89277573106b admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:26:27.132111 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-56b41e71-db4a-4d7c-9f19-89277573106b admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.085464 Jun 29 12:26:27.132813 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1291 bytes} [Wed Jun 29 12:26:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:26:29.299865 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-f7939b72-ffb6-4568-b598-575e188a38ed admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:26:29.300881 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-f7939b72-ffb6-4568-b598-575e188a38ed admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 29 12:26:29.301279 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 12:26:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:26:29.368011 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-7550fd6b-d559-459c-b891-c138b169b6cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "1", "ram": 512, "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:26:29.386103 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-7550fd6b-d559-459c-b891-c138b169b6cf admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.078864 Jun 29 12:26:29.386701 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Jun 29 12:26:29 2022] POST /compute/v2.1/flavors => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 12:26:29.401352 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-53eee122-04c9-4278-a62f-b0f161b3534e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:26:29.427098 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-53eee122-04c9-4278-a62f-b0f161b3534e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029689 Jun 29 12:26:29.427825 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1332 bytes} [Wed Jun 29 12:26:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:26:32.009951 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-7550fd6b-d559-459c-b891-c138b169b6cf admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:26:32.011278 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-7550fd6b-d559-459c-b891-c138b169b6cf admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001903 Jun 29 12:26:32.011763 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 12:26:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:26:32.084063 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-e3c3ed1e-80ca-4fda-b31f-eed329ffd8d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "2", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.small", "disk": 20, "rxtx_factor": 1.0}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:26:32.106024 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-e3c3ed1e-80ca-4fda-b31f-eed329ffd8d1 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.086479 Jun 29 12:26:32.106782 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Jun 29 12:26:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 12:26:32.119218 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-5721e8cb-8347-499b-8527-38924a6b5545 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:26:32.145517 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-5721e8cb-8347-499b-8527-38924a6b5545 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029888 Jun 29 12:26:32.146098 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1332 bytes} [Wed Jun 29 12:26:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:26:34.255553 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-e3c3ed1e-80ca-4fda-b31f-eed329ffd8d1 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:26:34.256619 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-e3c3ed1e-80ca-4fda-b31f-eed329ffd8d1 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jun 29 12:26:34.257045 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 12:26:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:26:34.326586 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-81f1d328-bdb5-43dd-b597-4d168843218a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "id": "3", "name": "m1.medium", "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:26:34.345132 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-81f1d328-bdb5-43dd-b597-4d168843218a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.082110 Jun 29 12:26:34.345988 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Jun 29 12:26:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 12:26:34.357705 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-851bc9ef-c483-4c74-b0b9-7404cfe507f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:26:34.384024 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-851bc9ef-c483-4c74-b0b9-7404cfe507f9 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029795 Jun 29 12:26:34.384744 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1332 bytes} [Wed Jun 29 12:26:34 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:26:36.468032 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-81f1d328-bdb5-43dd-b597-4d168843218a admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:26:36.469035 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-81f1d328-bdb5-43dd-b597-4d168843218a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jun 29 12:26:36.469647 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 12:26:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:26:36.528108 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-e382db01-7183-433d-904a-3f2adcdbc5be admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "4", "ram": 8192, "disk": 80, "swap": 0, "vcpus": 4, "name": "m1.large", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:26:36.547119 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-e382db01-7183-433d-904a-3f2adcdbc5be admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071807 Jun 29 12:26:36.548396 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Jun 29 12:26:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 12:26:36.559932 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-f57d94b5-3269-45a8-a21f-b41e9a62ced1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:26:36.593393 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-f57d94b5-3269-45a8-a21f-b41e9a62ced1 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036983 Jun 29 12:26:36.593979 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1332 bytes} [Wed Jun 29 12:26:36 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:26:38.664558 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-e382db01-7183-433d-904a-3f2adcdbc5be admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:26:38.665585 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-e382db01-7183-433d-904a-3f2adcdbc5be admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jun 29 12:26:38.665989 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 12:26:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:26:38.732148 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-fb84649d-dbee-4921-ab52-15703217edcc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "rxtx_factor": 1.0, "disk": 160, "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0, "ram": 16384, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:26:38.752308 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-fb84649d-dbee-4921-ab52-15703217edcc admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.080488 Jun 29 12:26:38.752872 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1282 bytes} [Wed Jun 29 12:26:38 2022] POST /compute/v2.1/flavors => generated 408 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 12:26:38.764388 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-f0028c82-5cb6-463b-987c-16ec4f919c65 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:26:38.795611 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-f0028c82-5cb6-463b-987c-16ec4f919c65 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034528 Jun 29 12:26:38.796556 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1332 bytes} [Wed Jun 29 12:26:38 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:27:03.277108 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-fb84649d-dbee-4921-ab52-15703217edcc admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:03.278110 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-fb84649d-dbee-4921-ab52-15703217edcc admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jun 29 12:27:03.278540 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 12:27:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:27:03.289824 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:03.337360 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-02c51493-5b8f-4581-b41f-8ab32e56f473 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:03.355181 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-02c51493-5b8f-4581-b41f-8ab32e56f473 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069778 Jun 29 12:27:03.355646 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1291 bytes} [Wed Jun 29 12:27:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:27:04.265365 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-fb84649d-dbee-4921-ab52-15703217edcc admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:04.266359 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-fb84649d-dbee-4921-ab52-15703217edcc admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 29 12:27:04.266791 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Jun 29 12:27:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:27:04.459171 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-2a3da1c0-0c9d-4ade-b223-b994a22e3ba6 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:04.464720 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.wsgi [None req-2a3da1c0-0c9d-4ade-b223-b994a22e3ba6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 29 12:27:04.467986 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-2a3da1c0-0c9d-4ade-b223-b994a22e3ba6 admin admin] Request method failure captured: Jun 29 12:27:04.467986 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 29 12:27:04.467986 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: Accept: application/json Jun 29 12:27:04.467986 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: Accept-Encoding: gzip, deflate Jun 29 12:27:04.467986 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: Connection: keep-alive Jun 29 12:27:04.467986 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: Content-Length: 0 Jun 29 12:27:04.467986 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: Host: 10.222.0.52 Jun 29 12:27:04.467986 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: Openstack-Api-Version: compute 2.90 Jun 29 12:27:04.467986 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: Openstack-System-Scope: None Jun 29 12:27:04.467986 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: User-Agent: python-novaclient Jun 29 12:27:04.467986 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Auth-Token: gAAAAABivEUYYgWHw8KjwhVu6vn4xawaXIXTiwzn_ugTvCv7x-GZOK9qRvuupnz13Odaory0YdCm5BX4R7lZsbajJUlBKS2uLuFfT64ouBgYXAzgd2Y43Sphf9KcrEnLHsbXrDgzotn7z84XURIiLsCEAm5sUuXFSiTtnig0JEf_OO-q3-qBPoE Jun 29 12:27:04.467986 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Domain-Id: None Jun 29 12:27:04.467986 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Domain-Name: None Jun 29 12:27:04.467986 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Identity-Status: Confirmed Jun 29 12:27:04.467986 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Is-Admin-Project: True Jun 29 12:27:04.467986 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 12:27:04.467986 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Project-Domain-Id: default Jun 29 12:27:04.467986 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Project-Domain-Name: Default Jun 29 12:27:04.467986 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Project-Id: a19795d69941402bbd95f8c9172fb339 Jun 29 12:27:04.467986 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Project-Name: admin Jun 29 12:27:04.467986 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Role: member,reader,admin Jun 29 12:27:04.467986 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Roles: member,reader,admin Jun 29 12:27:04.470531 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a19795d69941402bbd95f8c9172fb339", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a19795d69941402bbd95f8c9172fb339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a19795d69941402bbd95f8c9172fb339"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a19795d69941402bbd95f8c9172fb339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:27:04.470531 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Tenant: admin Jun 29 12:27:04.470531 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Tenant-Id: a19795d69941402bbd95f8c9172fb339 Jun 29 12:27:04.470531 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Tenant-Name: admin Jun 29 12:27:04.470531 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-User: admin Jun 29 12:27:04.470531 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-User-Domain-Id: default Jun 29 12:27:04.470531 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-User-Domain-Name: Default Jun 29 12:27:04.470531 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-User-Id: 96982c6fb7694d38b8d0a9278de02353 Jun 29 12:27:04.470531 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-User-Name: admin Jun 29 12:27:04.470531 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: method: > Jun 29 12:27:04.470531 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: exception: Flavor 42 could not be found. Jun 29 12:27:04.470531 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: action_args: {'id': '42'} Jun 29 12:27:04.470531 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:27:04.470531 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:27:04.471584 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 12:27:04.471584 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 12:27:04.471584 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 12:27:04.471584 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 12:27:04.471584 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 12:27:04.471584 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 12:27:04.471584 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 12:27:04.471584 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 12:27:04.471584 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 12:27:04.471584 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:27:04.471584 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 12:27:04.471584 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 12:27:04.471584 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 29 12:27:04.471584 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jun 29 12:27:04.471584 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:27:04.471584 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jun 29 12:27:04.471584 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:27:04.471584 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:27:04.471584 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:27:04.473031 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:27:04.473031 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:27:04.473031 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:27:04.473031 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:27:04.473031 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 12:27:04.473031 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:27:04.473031 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 29 12:27:04.473031 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jun 29 12:27:04.473031 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:27:04.473031 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jun 29 12:27:04.473031 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:27:04.473031 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:27:04.473031 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:27:04.473031 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:27:04.473031 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:27:04.473031 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 29 12:27:04.473031 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jun 29 12:27:04.473031 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-2a3da1c0-0c9d-4ade-b223-b994a22e3ba6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:27:04.474508 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-2a3da1c0-0c9d-4ade-b223-b994a22e3ba6 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060784 Jun 29 12:27:04.474508 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Jun 29 12:27:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 12:27:04.479519 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-3ed69f80-3620-4486-94c3-4bb7f6f737d1 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:04.482289 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:04.501641 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-3ed69f80-3620-4486-94c3-4bb7f6f737d1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025647 Jun 29 12:27:04.502171 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Jun 29 12:27:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:27:04.511693 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-43880198-d27a-4ea6-96d8-01ba82b8887f admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:04.534014 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-43880198-d27a-4ea6-96d8-01ba82b8887f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025825 Jun 29 12:27:04.534565 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Jun 29 12:27:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:27:04.544185 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-f98414e1-f757-4be9-97be-fa8e7585fee9 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:04.550792 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.wsgi [None req-f98414e1-f757-4be9-97be-fa8e7585fee9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 29 12:27:04.554048 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-f98414e1-f757-4be9-97be-fa8e7585fee9 admin admin] Request method failure captured: Jun 29 12:27:04.554048 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 29 12:27:04.554048 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: Accept: application/json Jun 29 12:27:04.554048 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: Accept-Encoding: gzip, deflate Jun 29 12:27:04.554048 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: Connection: keep-alive Jun 29 12:27:04.554048 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: Content-Length: 0 Jun 29 12:27:04.554048 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: Host: 10.222.0.52 Jun 29 12:27:04.554048 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: Openstack-Api-Version: compute 2.90 Jun 29 12:27:04.554048 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: Openstack-System-Scope: None Jun 29 12:27:04.554048 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: User-Agent: python-novaclient Jun 29 12:27:04.554048 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Auth-Token: gAAAAABivEUYYgWHw8KjwhVu6vn4xawaXIXTiwzn_ugTvCv7x-GZOK9qRvuupnz13Odaory0YdCm5BX4R7lZsbajJUlBKS2uLuFfT64ouBgYXAzgd2Y43Sphf9KcrEnLHsbXrDgzotn7z84XURIiLsCEAm5sUuXFSiTtnig0JEf_OO-q3-qBPoE Jun 29 12:27:04.554048 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Domain-Id: None Jun 29 12:27:04.554048 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Domain-Name: None Jun 29 12:27:04.554048 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Identity-Status: Confirmed Jun 29 12:27:04.554048 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Is-Admin-Project: True Jun 29 12:27:04.554048 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 12:27:04.554048 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Project-Domain-Id: default Jun 29 12:27:04.554048 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Project-Domain-Name: Default Jun 29 12:27:04.554048 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Project-Id: a19795d69941402bbd95f8c9172fb339 Jun 29 12:27:04.554048 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Project-Name: admin Jun 29 12:27:04.554048 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Role: member,reader,admin Jun 29 12:27:04.554048 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Roles: member,reader,admin Jun 29 12:27:04.555600 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a19795d69941402bbd95f8c9172fb339", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a19795d69941402bbd95f8c9172fb339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a19795d69941402bbd95f8c9172fb339"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a19795d69941402bbd95f8c9172fb339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:27:04.555600 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Tenant: admin Jun 29 12:27:04.555600 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Tenant-Id: a19795d69941402bbd95f8c9172fb339 Jun 29 12:27:04.555600 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Tenant-Name: admin Jun 29 12:27:04.555600 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-User: admin Jun 29 12:27:04.555600 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-User-Domain-Id: default Jun 29 12:27:04.555600 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-User-Domain-Name: Default Jun 29 12:27:04.555600 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-User-Id: 96982c6fb7694d38b8d0a9278de02353 Jun 29 12:27:04.555600 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-User-Name: admin Jun 29 12:27:04.555600 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: method: > Jun 29 12:27:04.555600 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: exception: Flavor 42 could not be found. Jun 29 12:27:04.555600 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: action_args: {'id': '42'} Jun 29 12:27:04.555600 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:27:04.555600 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:27:04.557402 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 12:27:04.557402 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 12:27:04.557402 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 12:27:04.557402 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 12:27:04.557402 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 12:27:04.557402 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 12:27:04.557402 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 12:27:04.557402 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 12:27:04.557402 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 12:27:04.557402 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:27:04.557402 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 12:27:04.557402 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 12:27:04.557402 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 29 12:27:04.557402 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Jun 29 12:27:04.557402 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:27:04.557402 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Jun 29 12:27:04.557402 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:27:04.557402 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:27:04.557402 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:27:04.558451 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:27:04.558451 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:27:04.558451 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:27:04.558451 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:27:04.558451 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 12:27:04.558451 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:27:04.558451 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 29 12:27:04.558451 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Jun 29 12:27:04.558451 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:27:04.558451 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Jun 29 12:27:04.558451 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:27:04.558451 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:27:04.558451 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:27:04.558451 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:27:04.558451 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:27:04.558451 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 29 12:27:04.558451 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Jun 29 12:27:04.558451 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-f98414e1-f757-4be9-97be-fa8e7585fee9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:27:04.559452 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-f98414e1-f757-4be9-97be-fa8e7585fee9 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015441 Jun 29 12:27:04.559452 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Jun 29 12:27:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 29 12:27:05.376214 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-43880198-d27a-4ea6-96d8-01ba82b8887f admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:05.377248 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-43880198-d27a-4ea6-96d8-01ba82b8887f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 29 12:27:05.377642 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Jun 29 12:27:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:27:05.571873 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-d42d8727-b267-4f2d-8282-5440befa29e7 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:05.578264 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.wsgi [None req-d42d8727-b267-4f2d-8282-5440befa29e7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 29 12:27:05.579945 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-d42d8727-b267-4f2d-8282-5440befa29e7 admin admin] Request method failure captured: Jun 29 12:27:05.579945 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 29 12:27:05.579945 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: Accept: application/json Jun 29 12:27:05.579945 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: Accept-Encoding: gzip, deflate Jun 29 12:27:05.579945 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: Connection: keep-alive Jun 29 12:27:05.579945 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: Content-Length: 0 Jun 29 12:27:05.579945 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: Host: 10.222.0.52 Jun 29 12:27:05.579945 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: Openstack-Api-Version: compute 2.90 Jun 29 12:27:05.579945 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: Openstack-System-Scope: None Jun 29 12:27:05.579945 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: User-Agent: python-novaclient Jun 29 12:27:05.579945 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Auth-Token: gAAAAABivEUZGzHO1wgd4C77xmdvx7W64GRdvLCiscfMAYX-O40ZbQedH_UQAMpxb0lVp7xSw3OqqGnPtI46AAC345BVDK6anFn3aHhAJMjiFAD25yvnbp8qZN1ePuEdu93dqKGhYr6TTqqhfn4IPqHH4Ssh1tFcJsmw-Ii-6N1kveu4-qEmiws Jun 29 12:27:05.579945 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Domain-Id: None Jun 29 12:27:05.579945 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Domain-Name: None Jun 29 12:27:05.579945 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Identity-Status: Confirmed Jun 29 12:27:05.579945 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Is-Admin-Project: True Jun 29 12:27:05.579945 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 12:27:05.579945 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Project-Domain-Id: default Jun 29 12:27:05.579945 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Project-Domain-Name: Default Jun 29 12:27:05.579945 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Project-Id: a19795d69941402bbd95f8c9172fb339 Jun 29 12:27:05.579945 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Project-Name: admin Jun 29 12:27:05.579945 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Role: member,reader,admin Jun 29 12:27:05.579945 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Roles: member,reader,admin Jun 29 12:27:05.581506 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a19795d69941402bbd95f8c9172fb339", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a19795d69941402bbd95f8c9172fb339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a19795d69941402bbd95f8c9172fb339"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a19795d69941402bbd95f8c9172fb339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:27:05.581506 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Tenant: admin Jun 29 12:27:05.581506 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Tenant-Id: a19795d69941402bbd95f8c9172fb339 Jun 29 12:27:05.581506 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Tenant-Name: admin Jun 29 12:27:05.581506 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-User: admin Jun 29 12:27:05.581506 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-User-Domain-Id: default Jun 29 12:27:05.581506 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-User-Domain-Name: Default Jun 29 12:27:05.581506 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-User-Id: 96982c6fb7694d38b8d0a9278de02353 Jun 29 12:27:05.581506 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-User-Name: admin Jun 29 12:27:05.581506 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: method: > Jun 29 12:27:05.581506 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: exception: Flavor 84 could not be found. Jun 29 12:27:05.581506 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: action_args: {'id': '84'} Jun 29 12:27:05.581506 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:27:05.581506 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:27:05.582525 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 12:27:05.582525 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 12:27:05.582525 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 12:27:05.582525 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 12:27:05.582525 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 12:27:05.582525 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 12:27:05.582525 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 12:27:05.582525 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 12:27:05.582525 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 12:27:05.582525 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:27:05.582525 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 12:27:05.582525 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 12:27:05.582525 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 29 12:27:05.582525 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Jun 29 12:27:05.582525 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:27:05.582525 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Jun 29 12:27:05.582525 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:27:05.582525 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:27:05.582525 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:27:05.583724 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:27:05.583724 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:27:05.583724 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:27:05.583724 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:27:05.583724 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 12:27:05.583724 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:27:05.583724 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 29 12:27:05.583724 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Jun 29 12:27:05.583724 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:27:05.583724 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Jun 29 12:27:05.583724 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:27:05.583724 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:27:05.583724 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:27:05.583724 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:27:05.583724 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:27:05.583724 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 29 12:27:05.583724 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Jun 29 12:27:05.583724 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-d42d8727-b267-4f2d-8282-5440befa29e7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:27:05.584770 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-d42d8727-b267-4f2d-8282-5440befa29e7 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060986 Jun 29 12:27:05.584770 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Jun 29 12:27:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 12:27:05.590878 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-b90dde7d-e576-41a9-a389-a3b492bd9bee admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:05.606009 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-b90dde7d-e576-41a9-a389-a3b492bd9bee admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018686 Jun 29 12:27:05.606567 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Jun 29 12:27:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:27:05.615813 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-89c32448-df08-4bcf-ab6a-596a8e803956 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:05.629636 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-89c32448-df08-4bcf-ab6a-596a8e803956 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017317 Jun 29 12:27:05.630151 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Jun 29 12:27:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:27:05.638926 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-40556cd4-5e4a-48f3-ac72-6a2d7d843d70 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:05.644918 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.wsgi [None req-40556cd4-5e4a-48f3-ac72-6a2d7d843d70 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 29 12:27:05.646408 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-40556cd4-5e4a-48f3-ac72-6a2d7d843d70 admin admin] Request method failure captured: Jun 29 12:27:05.646408 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 29 12:27:05.646408 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: Accept: application/json Jun 29 12:27:05.646408 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: Accept-Encoding: gzip, deflate Jun 29 12:27:05.646408 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: Connection: keep-alive Jun 29 12:27:05.646408 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: Content-Length: 0 Jun 29 12:27:05.646408 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: Host: 10.222.0.52 Jun 29 12:27:05.646408 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: Openstack-Api-Version: compute 2.90 Jun 29 12:27:05.646408 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: Openstack-System-Scope: None Jun 29 12:27:05.646408 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: User-Agent: python-novaclient Jun 29 12:27:05.646408 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Auth-Token: gAAAAABivEUZGzHO1wgd4C77xmdvx7W64GRdvLCiscfMAYX-O40ZbQedH_UQAMpxb0lVp7xSw3OqqGnPtI46AAC345BVDK6anFn3aHhAJMjiFAD25yvnbp8qZN1ePuEdu93dqKGhYr6TTqqhfn4IPqHH4Ssh1tFcJsmw-Ii-6N1kveu4-qEmiws Jun 29 12:27:05.646408 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Domain-Id: None Jun 29 12:27:05.646408 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Domain-Name: None Jun 29 12:27:05.646408 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Identity-Status: Confirmed Jun 29 12:27:05.646408 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Is-Admin-Project: True Jun 29 12:27:05.646408 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 12:27:05.646408 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Project-Domain-Id: default Jun 29 12:27:05.646408 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Project-Domain-Name: Default Jun 29 12:27:05.646408 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Project-Id: a19795d69941402bbd95f8c9172fb339 Jun 29 12:27:05.646408 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Project-Name: admin Jun 29 12:27:05.646408 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Role: member,reader,admin Jun 29 12:27:05.646408 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Roles: member,reader,admin Jun 29 12:27:05.648263 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a19795d69941402bbd95f8c9172fb339", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a19795d69941402bbd95f8c9172fb339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a19795d69941402bbd95f8c9172fb339"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a19795d69941402bbd95f8c9172fb339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:27:05.648263 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Tenant: admin Jun 29 12:27:05.648263 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Tenant-Id: a19795d69941402bbd95f8c9172fb339 Jun 29 12:27:05.648263 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Tenant-Name: admin Jun 29 12:27:05.648263 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-User: admin Jun 29 12:27:05.648263 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-User-Domain-Id: default Jun 29 12:27:05.648263 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-User-Domain-Name: Default Jun 29 12:27:05.648263 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-User-Id: 96982c6fb7694d38b8d0a9278de02353 Jun 29 12:27:05.648263 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-User-Name: admin Jun 29 12:27:05.648263 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: method: > Jun 29 12:27:05.648263 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: exception: Flavor 84 could not be found. Jun 29 12:27:05.648263 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: action_args: {'id': '84'} Jun 29 12:27:05.648263 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:27:05.648263 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:27:05.649352 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 12:27:05.649352 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 12:27:05.649352 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 12:27:05.649352 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 12:27:05.649352 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 12:27:05.649352 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 12:27:05.649352 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 12:27:05.649352 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 12:27:05.649352 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 12:27:05.649352 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:27:05.649352 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 12:27:05.649352 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 12:27:05.649352 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 29 12:27:05.649352 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jun 29 12:27:05.649352 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:27:05.649352 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jun 29 12:27:05.649352 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:27:05.649352 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:27:05.649352 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:27:05.650693 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:27:05.650693 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:27:05.650693 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:27:05.650693 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:27:05.650693 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 12:27:05.650693 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:27:05.650693 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 29 12:27:05.650693 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jun 29 12:27:05.650693 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:27:05.650693 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jun 29 12:27:05.650693 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:27:05.650693 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:27:05.650693 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:27:05.650693 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:27:05.650693 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:27:05.650693 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 29 12:27:05.650693 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jun 29 12:27:05.650693 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-40556cd4-5e4a-48f3-ac72-6a2d7d843d70 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:27:05.651973 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-40556cd4-5e4a-48f3-ac72-6a2d7d843d70 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012293 Jun 29 12:27:05.651973 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Jun 29 12:27:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 29 12:27:06.461720 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-89c32448-df08-4bcf-ab6a-596a8e803956 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:06.462752 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-89c32448-df08-4bcf-ab6a-596a8e803956 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jun 29 12:27:06.463153 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Jun 29 12:27:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:27:06.651404 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-84d129da-405f-4833-b6b5-b01899f2635d admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:06.657662 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.wsgi [None req-84d129da-405f-4833-b6b5-b01899f2635d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 29 12:27:06.659217 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-84d129da-405f-4833-b6b5-b01899f2635d admin admin] Request method failure captured: Jun 29 12:27:06.659217 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 29 12:27:06.659217 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: Accept: application/json Jun 29 12:27:06.659217 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: Accept-Encoding: gzip, deflate Jun 29 12:27:06.659217 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: Connection: keep-alive Jun 29 12:27:06.659217 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: Content-Length: 0 Jun 29 12:27:06.659217 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: Host: 10.222.0.52 Jun 29 12:27:06.659217 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: Openstack-Api-Version: compute 2.90 Jun 29 12:27:06.659217 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: Openstack-System-Scope: None Jun 29 12:27:06.659217 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: User-Agent: python-novaclient Jun 29 12:27:06.659217 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Auth-Token: gAAAAABivEUaHB65QxCxoO2G69Oe-x5RxaqSBUXhmx19x-_jop2HSkNwhh_9wSIJbK_ZXYHzVDwMCyPEntv5HaUe8w3gRQl1SLv6ivdq3LZpVpnxpdbShWkdUz0E1-6axbZNQdqHl95DUASxjCHJRgZWruUcekMpPkTii2V3h8yj2BfhGSsrd0M Jun 29 12:27:06.659217 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Domain-Id: None Jun 29 12:27:06.659217 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Domain-Name: None Jun 29 12:27:06.659217 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Identity-Status: Confirmed Jun 29 12:27:06.659217 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Is-Admin-Project: True Jun 29 12:27:06.659217 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 12:27:06.659217 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Project-Domain-Id: default Jun 29 12:27:06.659217 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Project-Domain-Name: Default Jun 29 12:27:06.659217 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Project-Id: a19795d69941402bbd95f8c9172fb339 Jun 29 12:27:06.659217 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Project-Name: admin Jun 29 12:27:06.659217 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Role: member,reader,admin Jun 29 12:27:06.659217 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Roles: member,reader,admin Jun 29 12:27:06.660769 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a19795d69941402bbd95f8c9172fb339", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a19795d69941402bbd95f8c9172fb339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a19795d69941402bbd95f8c9172fb339"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a19795d69941402bbd95f8c9172fb339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:27:06.660769 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Tenant: admin Jun 29 12:27:06.660769 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Tenant-Id: a19795d69941402bbd95f8c9172fb339 Jun 29 12:27:06.660769 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-Tenant-Name: admin Jun 29 12:27:06.660769 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-User: admin Jun 29 12:27:06.660769 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-User-Domain-Id: default Jun 29 12:27:06.660769 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-User-Domain-Name: Default Jun 29 12:27:06.660769 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-User-Id: 96982c6fb7694d38b8d0a9278de02353 Jun 29 12:27:06.660769 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: X-User-Name: admin Jun 29 12:27:06.660769 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: method: > Jun 29 12:27:06.660769 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: exception: Flavor 451 could not be found. Jun 29 12:27:06.660769 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: action_args: {'id': '451'} Jun 29 12:27:06.660769 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:27:06.660769 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:27:06.661759 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 12:27:06.661759 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 12:27:06.661759 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 12:27:06.661759 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 12:27:06.661759 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 12:27:06.661759 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 12:27:06.661759 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 12:27:06.661759 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 12:27:06.661759 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 12:27:06.661759 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:27:06.661759 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 12:27:06.661759 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 12:27:06.661759 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 29 12:27:06.661759 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jun 29 12:27:06.661759 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:27:06.661759 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jun 29 12:27:06.661759 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:27:06.661759 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:27:06.661759 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:27:06.662993 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:27:06.662993 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:27:06.662993 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:27:06.662993 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:27:06.662993 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 12:27:06.662993 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:27:06.662993 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 29 12:27:06.662993 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jun 29 12:27:06.662993 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:27:06.662993 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jun 29 12:27:06.662993 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:27:06.662993 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:27:06.662993 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:27:06.662993 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:27:06.662993 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:27:06.662993 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 29 12:27:06.662993 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jun 29 12:27:06.662993 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-84d129da-405f-4833-b6b5-b01899f2635d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:27:06.663983 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-84d129da-405f-4833-b6b5-b01899f2635d admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060619 Jun 29 12:27:06.663983 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Jun 29 12:27:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 12:27:06.670061 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-0a3bcce5-f595-4edf-a637-0b505041b4a5 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:06.684911 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-0a3bcce5-f595-4edf-a637-0b505041b4a5 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018425 Jun 29 12:27:06.685426 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Jun 29 12:27:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:27:06.694739 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-e4decd83-e99f-47dd-b380-647fc0384f49 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:06.708936 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-e4decd83-e99f-47dd-b380-647fc0384f49 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017651 Jun 29 12:27:06.709464 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Jun 29 12:27:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:27:06.719343 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-954cd9d9-5758-4af6-8916-97e62fcd6d9a admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:06.724649 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.wsgi [None req-954cd9d9-5758-4af6-8916-97e62fcd6d9a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 29 12:27:06.726159 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-954cd9d9-5758-4af6-8916-97e62fcd6d9a admin admin] Request method failure captured: Jun 29 12:27:06.726159 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 29 12:27:06.726159 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: Accept: application/json Jun 29 12:27:06.726159 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: Accept-Encoding: gzip, deflate Jun 29 12:27:06.726159 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: Connection: keep-alive Jun 29 12:27:06.726159 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: Content-Length: 0 Jun 29 12:27:06.726159 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: Host: 10.222.0.52 Jun 29 12:27:06.726159 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: Openstack-Api-Version: compute 2.90 Jun 29 12:27:06.726159 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: Openstack-System-Scope: None Jun 29 12:27:06.726159 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: User-Agent: python-novaclient Jun 29 12:27:06.726159 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Auth-Token: gAAAAABivEUaHB65QxCxoO2G69Oe-x5RxaqSBUXhmx19x-_jop2HSkNwhh_9wSIJbK_ZXYHzVDwMCyPEntv5HaUe8w3gRQl1SLv6ivdq3LZpVpnxpdbShWkdUz0E1-6axbZNQdqHl95DUASxjCHJRgZWruUcekMpPkTii2V3h8yj2BfhGSsrd0M Jun 29 12:27:06.726159 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Domain-Id: None Jun 29 12:27:06.726159 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Domain-Name: None Jun 29 12:27:06.726159 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Identity-Status: Confirmed Jun 29 12:27:06.726159 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Is-Admin-Project: True Jun 29 12:27:06.726159 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 12:27:06.726159 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Project-Domain-Id: default Jun 29 12:27:06.726159 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Project-Domain-Name: Default Jun 29 12:27:06.726159 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Project-Id: a19795d69941402bbd95f8c9172fb339 Jun 29 12:27:06.726159 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Project-Name: admin Jun 29 12:27:06.726159 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Role: member,reader,admin Jun 29 12:27:06.726159 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Roles: member,reader,admin Jun 29 12:27:06.727697 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a19795d69941402bbd95f8c9172fb339", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a19795d69941402bbd95f8c9172fb339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a19795d69941402bbd95f8c9172fb339"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a19795d69941402bbd95f8c9172fb339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:27:06.727697 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Tenant: admin Jun 29 12:27:06.727697 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Tenant-Id: a19795d69941402bbd95f8c9172fb339 Jun 29 12:27:06.727697 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-Tenant-Name: admin Jun 29 12:27:06.727697 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-User: admin Jun 29 12:27:06.727697 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-User-Domain-Id: default Jun 29 12:27:06.727697 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-User-Domain-Name: Default Jun 29 12:27:06.727697 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-User-Id: 96982c6fb7694d38b8d0a9278de02353 Jun 29 12:27:06.727697 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: X-User-Name: admin Jun 29 12:27:06.727697 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: method: > Jun 29 12:27:06.727697 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: exception: Flavor 451 could not be found. Jun 29 12:27:06.727697 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: action_args: {'id': '451'} Jun 29 12:27:06.727697 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:27:06.727697 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:27:06.728669 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 12:27:06.728669 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 12:27:06.728669 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 12:27:06.728669 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 12:27:06.728669 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 12:27:06.728669 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 12:27:06.728669 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 12:27:06.728669 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 12:27:06.728669 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 12:27:06.728669 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:27:06.728669 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 12:27:06.728669 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 12:27:06.728669 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 29 12:27:06.728669 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Jun 29 12:27:06.728669 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:27:06.728669 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Jun 29 12:27:06.728669 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:27:06.728669 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:27:06.728669 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:27:06.730063 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:27:06.730063 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:27:06.730063 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:27:06.730063 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:27:06.730063 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 12:27:06.730063 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:27:06.730063 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 29 12:27:06.730063 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Jun 29 12:27:06.730063 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:27:06.730063 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Jun 29 12:27:06.730063 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:27:06.730063 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:27:06.730063 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:27:06.730063 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:27:06.730063 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:27:06.730063 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 29 12:27:06.730063 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Jun 29 12:27:06.730063 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-954cd9d9-5758-4af6-8916-97e62fcd6d9a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:27:06.731339 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-954cd9d9-5758-4af6-8916-97e62fcd6d9a admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012470 Jun 29 12:27:06.731339 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Jun 29 12:27:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 29 12:27:07.542864 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-e4decd83-e99f-47dd-b380-647fc0384f49 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:07.543863 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-e4decd83-e99f-47dd-b380-647fc0384f49 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 29 12:27:07.544258 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Jun 29 12:27:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:27:07.736976 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-6922d1d8-634b-4aa9-8b68-37c49065d385 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:27:07.754219 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-6922d1d8-634b-4aa9-8b68-37c49065d385 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068364 Jun 29 12:27:07.754780 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Jun 29 12:27:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 12:27:08.586703 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-e4decd83-e99f-47dd-b380-647fc0384f49 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:08.587691 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-e4decd83-e99f-47dd-b380-647fc0384f49 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jun 29 12:27:08.588080 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Jun 29 12:27:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:27:08.777018 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-9f7d4004-00bb-4e9c-860d-921a3bdfb9bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:27:08.794276 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-9f7d4004-00bb-4e9c-860d-921a3bdfb9bd admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068369 Jun 29 12:27:08.794851 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Jun 29 12:27:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 12:27:09.612730 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-e4decd83-e99f-47dd-b380-647fc0384f49 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:09.613784 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-e4decd83-e99f-47dd-b380-647fc0384f49 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 29 12:27:09.614126 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Jun 29 12:27:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:27:09.805343 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-869dfdcc-0bbc-4c37-a552-5ba471184661 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:27:09.822413 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-869dfdcc-0bbc-4c37-a552-5ba471184661 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067600 Jun 29 12:27:09.822976 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Jun 29 12:27:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 12:27:10.652005 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-e4decd83-e99f-47dd-b380-647fc0384f49 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:10.652999 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-e4decd83-e99f-47dd-b380-647fc0384f49 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Jun 29 12:27:10.653389 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Jun 29 12:27:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:27:10.842468 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-bc718192-f6d9-41cd-926a-a7b0bb9b4b5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:27:10.860638 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-bc718192-f6d9-41cd-926a-a7b0bb9b4b5b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068916 Jun 29 12:27:10.861182 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Jun 29 12:27:10 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 12:27:11.676445 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-e4decd83-e99f-47dd-b380-647fc0384f49 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:11.677436 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-e4decd83-e99f-47dd-b380-647fc0384f49 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001396 Jun 29 12:27:11.677825 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Jun 29 12:27:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:27:11.864081 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-5db342bd-442d-4490-a454-c56230e16af6 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:11.883979 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-5db342bd-442d-4490-a454-c56230e16af6 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069785 Jun 29 12:27:11.884508 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Wed Jun 29 12:27:11 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:27:58.707477 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-e4decd83-e99f-47dd-b380-647fc0384f49 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:58.708499 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-e4decd83-e99f-47dd-b380-647fc0384f49 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 29 12:27:58.708889 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 930 bytes} [Wed Jun 29 12:27:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:27:58.719204 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:58.768323 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-86eaeae8-e699-4895-a8dd-59d9fcbf7945 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:58.787866 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-86eaeae8-e699-4895-a8dd-59d9fcbf7945 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073207 Jun 29 12:27:58.788405 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1291 bytes} [Wed Jun 29 12:27:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:27:58.811074 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-551b483e-054d-45b9-86e1-725b2a16af55 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:58.814519 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writing DB stats nova_api:SELECT=14 {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:27:58.819637 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-551b483e-054d-45b9-86e1-725b2a16af55 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012106 Jun 29 12:27:58.820147 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1282 bytes} [Wed Jun 29 12:27:58 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:27:58.831285 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-f93fbd42-0b4e-4527-a3c8-67ec2fe79527 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:58.838799 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-f93fbd42-0b4e-4527-a3c8-67ec2fe79527 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010989 Jun 29 12:27:58.839312 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1285 bytes} [Wed Jun 29 12:27:58 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:27:58.851092 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-6b27f46b-922b-4323-a900-024059d74a90 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:58.859134 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-6b27f46b-922b-4323-a900-024059d74a90 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011755 Jun 29 12:27:58.859639 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1285 bytes} [Wed Jun 29 12:27:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:27:58.870210 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-07cf469d-5095-4095-8102-c3107933e21e admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:27:58.877913 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-07cf469d-5095-4095-8102-c3107933e21e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011101 Jun 29 12:27:58.878446 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1282 bytes} [Wed Jun 29 12:27:58 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:31:14.304250 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-6b27f46b-922b-4323-a900-024059d74a90 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:31:14.305278 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-6b27f46b-922b-4323-a900-024059d74a90 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 29 12:31:14.305684 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 34/69] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Jun 29 12:31:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:31:14.451319 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writing DB stats nova_api:SELECT=6 {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:14.564739 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-ea71b548-3105-4f25-91ab-8ba0bf1d6298 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:31:14.565943 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:31:14.565943 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: warnings.warn(msg) Jun 29 12:31:14.567160 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-ea71b548-3105-4f25-91ab-8ba0bf1d6298 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:31:14.567607 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-ea71b548-3105-4f25-91ab-8ba0bf1d6298 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:31:14.568385 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-ea71b548-3105-4f25-91ab-8ba0bf1d6298 admin admin] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:31:14.568811 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-ea71b548-3105-4f25-91ab-8ba0bf1d6298 admin admin] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:31:14.602918 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-ea71b548-3105-4f25-91ab-8ba0bf1d6298 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.153135 Jun 29 12:31:14.603468 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 36/70] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Jun 29 12:31:14 2022] GET /compute/v2.1/os-services => generated 794 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 12:31:15.437841 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-6b27f46b-922b-4323-a900-024059d74a90 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:31:15.438872 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-6b27f46b-922b-4323-a900-024059d74a90 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jun 29 12:31:15.439302 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 35/71] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Jun 29 12:31:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:31:15.633808 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-fe10e29f-19ec-4e26-8f90-e1e37d70520c admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:31:15.635033 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:31:15.635033 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: warnings.warn(msg) Jun 29 12:31:15.636219 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-fe10e29f-19ec-4e26-8f90-e1e37d70520c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:31:15.636663 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-fe10e29f-19ec-4e26-8f90-e1e37d70520c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:31:15.637453 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-fe10e29f-19ec-4e26-8f90-e1e37d70520c admin admin] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:31:15.637885 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-fe10e29f-19ec-4e26-8f90-e1e37d70520c admin admin] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:31:15.659062 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-fe10e29f-19ec-4e26-8f90-e1e37d70520c admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.081389 Jun 29 12:31:15.659659 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 37/72] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Jun 29 12:31:15 2022] GET /compute/v2.1/os-services => generated 794 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 12:31:26.978235 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-6b27f46b-922b-4323-a900-024059d74a90 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:31:26.979283 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-6b27f46b-922b-4323-a900-024059d74a90 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 29 12:31:26.979715 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 36/73] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Jun 29 12:31:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:31:27.123760 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writing DB stats nova_cell0:SELECT=4 {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:27.124579 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writing DB stats nova_cell1:SELECT=4 {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:27.125191 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writing DB stats nova_api:SELECT=8 {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:31:27.173030 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-3cf11529-a198-494d-9b38-0e661d4dea13 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:31:27.174184 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:31:27.174184 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: warnings.warn(msg) Jun 29 12:31:27.175391 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-3cf11529-a198-494d-9b38-0e661d4dea13 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:31:27.175827 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-3cf11529-a198-494d-9b38-0e661d4dea13 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:31:27.176597 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-3cf11529-a198-494d-9b38-0e661d4dea13 admin admin] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:31:27.177019 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-3cf11529-a198-494d-9b38-0e661d4dea13 admin admin] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:31:27.201808 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-3cf11529-a198-494d-9b38-0e661d4dea13 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.082482 Jun 29 12:31:27.202346 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 38/74] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Jun 29 12:31:27 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:31:28.019471 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-6b27f46b-922b-4323-a900-024059d74a90 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:31:28.020467 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-6b27f46b-922b-4323-a900-024059d74a90 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Jun 29 12:31:28.021120 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 37/75] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Jun 29 12:31:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:31:28.208607 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-4ed5441e-03f7-4e09-a58d-7c2a7f447445 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:31:28.209755 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 12:31:28.209755 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: warnings.warn(msg) Jun 29 12:31:28.211034 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-4ed5441e-03f7-4e09-a58d-7c2a7f447445 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:31:28.211467 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-4ed5441e-03f7-4e09-a58d-7c2a7f447445 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:31:28.212259 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-4ed5441e-03f7-4e09-a58d-7c2a7f447445 admin admin] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:31:28.212684 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-4ed5441e-03f7-4e09-a58d-7c2a7f447445 admin admin] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:31:28.233771 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-4ed5441e-03f7-4e09-a58d-7c2a7f447445 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.076052 Jun 29 12:31:28.234245 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 39/76] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Jun 29 12:31:28 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:32:24.123222 dv-cinder-812685-12-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 29 12:32:24.124192 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: Wed Jun 29 12:32:24 2022 - graceful shutdown triggered... Jun 29 12:32:24.124666 dv-cinder-812685-12-iscsi devstack@n-api.service[103172]: Gracefully killing worker 1 (pid: 103172)... Jun 29 12:32:24.125338 dv-cinder-812685-12-iscsi devstack@n-api.service[103173]: Gracefully killing worker 2 (pid: 103173)... Jun 29 12:32:25.124521 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: worker 1 buried after 1 seconds Jun 29 12:32:25.124521 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: worker 2 buried after 1 seconds Jun 29 12:32:25.124521 dv-cinder-812685-12-iscsi devstack@n-api.service[103171]: goodbye to uWSGI. Jun 29 12:32:25.126112 dv-cinder-812685-12-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 29 12:32:25.126724 dv-cinder-812685-12-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 29 12:32:25.129690 dv-cinder-812685-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 29 12:32:25.140659 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 29 12:32:25.142986 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 29 12:32:25 2022] *** Jun 29 12:32:25.142986 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 29 12:32:25.142986 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 29 12:32:25.142986 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: nodename: dv-cinder-812685-12-iscsi Jun 29 12:32:25.142986 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: machine: x86_64 Jun 29 12:32:25.142986 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: clock source: unix Jun 29 12:32:25.142986 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: pcre jit disabled Jun 29 12:32:25.142986 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: detected number of CPU cores: 4 Jun 29 12:32:25.142986 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: current working directory: / Jun 29 12:32:25.142986 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: detected binary path: /usr/bin/uwsgi-core Jun 29 12:32:25.142986 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: your processes number limit is 47680 Jun 29 12:32:25.143734 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: your memory page size is 4096 bytes Jun 29 12:32:25.143734 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: detected max file descriptor number: 2048 Jun 29 12:32:25.143734 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: lock engine: pthread robust mutexes Jun 29 12:32:25.143734 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: thunder lock: enabled Jun 29 12:32:25.143734 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 29 12:32:25.143734 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 29 12:32:25.190453 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: Python main interpreter initialized at 0x55ebe12469c0 Jun 29 12:32:25.190453 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: python threads support enabled Jun 29 12:32:25.190453 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: your server socket listen backlog is limited to 100 connections Jun 29 12:32:25.190453 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: your mercy for graceful operations on workers is 90 seconds Jun 29 12:32:25.190937 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: mapped 403077 bytes (393 KB) for 2 cores Jun 29 12:32:25.190937 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: *** Operational MODE: preforking *** Jun 29 12:32:25.191163 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: *** uWSGI is running in multiple interpreter mode *** Jun 29 12:32:25.191163 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: spawned uWSGI master process (pid: 124303) Jun 29 12:32:25.191370 dv-cinder-812685-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 29 12:32:25.192236 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: spawned uWSGI worker 1 (pid: 124316, cores: 1) Jun 29 12:32:25.194686 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: spawned uWSGI worker 2 (pid: 124317, cores: 1) Jun 29 12:32:25.194686 dv-cinder-812685-12-iscsi devstack@n-api.service[124303]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 29 12:32:25.864285 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 29 12:32:25.866713 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 29 12:32:27.086252 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 12:32:27.086252 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: from cryptography.utils import int_from_bytes Jun 29 12:32:27.087053 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 12:32:27.087053 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: from cryptography.utils import int_from_bytes Jun 29 12:32:27.102147 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 12:32:27.102147 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: from cryptography.utils import int_from_bytes Jun 29 12:32:27.102694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 12:32:27.102694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: from cryptography.utils import int_from_bytes Jun 29 12:32:29.606839 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 12:32:29.607435 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 12:32:29.607780 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 12:32:29.607968 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 12:32:29.608202 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 12:32:29.608608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.608933 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.609265 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.609718 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.610067 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.610390 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.610748 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.611077 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.611418 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.611690 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.612017 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.612359 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-12-iscsi {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.612694 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.613012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.613563 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.614107 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.614665 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.615006 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.615327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.616389 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.618022 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.618022 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.618022 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.618022 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.618393 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.618718 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.618950 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.619276 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.619601 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.619925 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.620334 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-12-iscsi {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.620677 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.620983 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.621311 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.621746 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.622070 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.622398 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.622769 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.623104 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.623428 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.623797 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.624111 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.624449 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.624772 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.625086 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.625404 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.625730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.626060 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.626378 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.626724 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.626984 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.627300 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.627632 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.627965 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.628299 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.628561 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.628821 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.629150 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.629481 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.629799 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.630116 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.630454 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.630778 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.631093 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.632489 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.632828 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.633150 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.633528 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.633880 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.634219 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.634564 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.634898 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.635318 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.635580 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.635899 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.636256 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.636587 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.636905 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.637233 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.637565 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.637884 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.638202 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.638548 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.638880 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.639227 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.639543 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.639803 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.640116 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.640429 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.640763 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.641079 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.641393 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.641709 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.642017 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.642334 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.642700 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.643020 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.643335 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.643649 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.643964 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.644285 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.644597 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.644914 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.645246 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.645830 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.646147 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.646488 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.646805 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.647733 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.648066 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.648386 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.648701 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.649208 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.649528 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.649846 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.650175 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.650532 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.650854 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.651186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.651342 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 12:32:29.651818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.651970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 12:32:29.652121 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.652327 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 12:32:29.652483 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.652483 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.652805 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 12:32:29.652805 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 12:32:29.653085 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.653085 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.653371 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.653520 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.653669 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.653811 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.653965 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.654107 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.654254 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.654415 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.654598 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.654740 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.654896 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.655039 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.655205 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.655359 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.655509 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.655661 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.655813 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.656186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.656337 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.656495 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.656679 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.656936 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.657096 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-12-iscsi {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.657245 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.657401 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.657546 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.657843 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.658001 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.658155 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.658298 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.658482 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.658482 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.658757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.658931 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.659074 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.659227 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.659376 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.659376 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.659664 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.659853 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.660064 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.660219 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.660361 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.660507 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.660668 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.660811 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.661062 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.661295 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.661454 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.661608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.661766 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.661915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.662058 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.662208 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.662350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.662556 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.663362 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.663567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.663713 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.663861 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.664018 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-12-iscsi {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.664162 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.664310 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.664457 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.664598 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.664746 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.664902 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.665051 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.665200 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.665355 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.665496 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.665646 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.665800 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.665941 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.666350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.666532 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.666677 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.666832 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.667060 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.667782 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.668100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.668257 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.668402 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.668543 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.668691 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.669082 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.669249 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.669395 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.669537 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.669737 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.669888 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.670058 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.670293 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.670505 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.670655 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.670804 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.670946 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.671196 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.671438 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.671597 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.671740 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.671881 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.672022 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.672176 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.673060 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.673224 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.673387 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.673541 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.673692 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.673840 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.673988 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.673988 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.674267 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.674444 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.674616 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.674767 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.674918 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.675077 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.675220 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.675369 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.675517 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.675666 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.675816 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.675958 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.676098 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.676370 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.676621 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.676769 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.676909 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.677240 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.677414 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.677567 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.677726 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.677877 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.678044 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.678379 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.678611 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.678769 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.678920 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.679069 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.679210 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.679359 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.679501 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.679736 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.679881 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.680029 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.680408 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.680575 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.680728 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.680879 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.681029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.681191 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.681449 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.681608 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.681933 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.682097 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.682247 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.682508 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.682609 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.682702 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.682702 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.682875 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.682965 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.683058 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.683143 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.683226 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.683322 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.683407 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.683490 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.683579 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.683669 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.683762 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.683853 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.683853 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.684020 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.684020 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.684190 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.684190 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.684385 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.684484 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.684576 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.684660 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.684744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.684828 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.684925 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.685010 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.685094 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.685186 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.685271 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.685354 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.685454 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.685538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.685622 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.685723 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.685816 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.685908 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.686005 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.686091 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.686176 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.686259 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.686719 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.686814 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.686909 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.686995 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.687086 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.687196 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.687284 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.687380 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.687472 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.687557 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.687641 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.687896 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.687992 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.688091 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.688203 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.688310 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.688409 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.688500 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.688585 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.688676 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.688767 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.688858 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.688951 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.689035 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.689125 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.689210 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.689300 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.689300 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.689469 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.689562 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.689646 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.689795 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.689929 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.690123 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.690222 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.690456 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.690577 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.690762 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.690864 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.691088 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.691183 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.691460 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.691565 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.691708 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.691805 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.692009 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.692103 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.692321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.692415 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.692631 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.692731 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.692941 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.693041 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.693251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.693353 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.693564 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.693673 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.693896 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.694023 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.694244 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.694344 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.694673 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.694784 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.694994 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.695084 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.695309 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.695400 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.695625 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.695734 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.695939 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.696038 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 12:32:29.696267 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.696367 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.696613 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.696767 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.696952 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.697055 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.697270 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.697363 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.697600 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.697706 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.697926 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.698048 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.698251 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.698358 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.698592 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.698695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.698903 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.699015 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.699222 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.699317 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.699536 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.699639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.699854 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.699947 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.700174 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.700276 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.700493 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.700610 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.700812 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.700922 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.701144 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.701254 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.701463 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.701564 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.701787 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.701895 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.702096 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.702258 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.702414 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.702523 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.702758 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.702874 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.703093 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.703198 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.703421 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.703516 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.703739 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.703835 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.704066 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.704174 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.704389 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.704492 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.704713 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.704814 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.705037 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.705141 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.705353 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.705456 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.705671 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.705771 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.705990 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.706099 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.706300 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.706396 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.706658 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.706769 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.707061 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.707174 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.707300 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.707398 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.707614 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.707732 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.708010 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.708122 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.708248 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.708337 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.708550 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.708671 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.708867 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.708963 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.709185 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.709288 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.710079 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.710198 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.710576 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.710686 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.710904 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.711027 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.711225 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.711362 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.711699 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.712028 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.712346 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.712667 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.712784 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.712981 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.713162 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.713294 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.713515 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.713615 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.713852 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.713955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.714186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.714281 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.714548 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.714740 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.714912 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.715062 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.715239 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.715399 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.715573 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.715685 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.715964 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.716121 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.716285 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.716439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.716593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.716736 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.716889 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.717062 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.717306 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.717455 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.717600 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.717743 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.717899 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.718049 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.718199 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.718367 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.718617 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.718770 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.718922 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.719066 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.719214 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.719358 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.719501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.719657 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.719800 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.719951 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.720093 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.720257 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.720412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.720569 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.720718 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.720861 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.721004 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.721152 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.721307 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.721462 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.721558 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.721748 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.721876 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.721995 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.722096 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.722347 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.722514 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.722711 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.722865 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.723052 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.723195 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.723367 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.723534 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.723702 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.723868 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.724033 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.724200 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.724360 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.724544 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.724672 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.724886 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.725005 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.725354 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.725497 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.725652 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.725764 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.725964 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.726075 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.726282 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.726377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.726635 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.726739 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.726917 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.727020 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.727229 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.727346 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.727542 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.727664 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.727850 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.727953 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.728179 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.728275 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.728494 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.728591 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.728804 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.728909 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.729116 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.729220 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.729426 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.729609 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.729775 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.729948 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.730087 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.730269 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.730454 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.730633 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.730803 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.730951 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.731130 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.731286 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.731462 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.731608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.731780 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.731924 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.732103 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.732261 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.732417 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.732539 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.732726 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.732895 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.733043 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.733213 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.733360 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.733569 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.733693 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.733926 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.734049 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.734266 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.734373 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.734612 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.734711 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.734930 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.735024 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.735269 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.735363 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.735585 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.735679 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.735903 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.736012 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.736219 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.736322 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.736539 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.736632 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.736858 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.736962 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.737174 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.737276 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.737496 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.737607 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.737818 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.737938 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.738132 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.738235 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.738485 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.738585 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.738778 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.738882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.739092 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.739193 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.739406 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.739506 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.739729 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.739831 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.740047 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.740149 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.740360 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.740465 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.741192 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.741298 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.741514 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.741615 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.741851 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.741995 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.742122 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.742236 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.742501 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.742646 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.742783 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.742889 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.743114 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.743221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.743433 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.743529 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.743751 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.743862 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.744066 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.744168 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.744386 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.744480 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.744700 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.744804 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.745014 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.745116 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.745329 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.745423 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.745642 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.745747 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.745954 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.746048 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.746270 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.746370 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.746616 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.746725 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.746932 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.747035 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.747246 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.747341 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.747559 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.747665 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.747879 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.747982 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.748195 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.748297 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.748505 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.748608 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.748812 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.748907 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.749127 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.749224 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.749442 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.749548 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.749757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.749852 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.750075 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.750170 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.750389 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.750554 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.750721 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.750824 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.751033 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.751136 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.751348 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.751443 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.751661 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.751757 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.751970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.752074 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.752283 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.752380 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.752598 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.752725 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.752909 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.753052 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.753222 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.753326 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.753549 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.753658 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.753870 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.753987 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.754198 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.754311 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.754536 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.754638 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.754863 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.754958 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.755179 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.755273 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.755494 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.755594 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.755824 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.755917 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.756145 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.756237 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.756518 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.756651 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.756843 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.757060 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.757168 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.757386 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.757504 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.757772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.757915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.758100 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.758199 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.758414 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.758630 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.758766 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.758883 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.759262 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.759370 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.759470 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.759563 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.759697 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.759799 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.760021 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.760122 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.760377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.760605 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.760788 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.760948 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.761095 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.761262 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.761409 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.761592 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.761748 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.761900 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.762045 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.762208 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.762359 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.762548 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.762663 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.762852 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.762951 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.763177 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.763293 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.763496 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.763602 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.763824 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.763926 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.764143 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.764248 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.764459 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.764561 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.764776 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.764878 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.765088 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.765183 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.765402 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.765497 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.765716 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.765824 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.766029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.766131 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.766338 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.766487 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.766678 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.766792 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.766992 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.767093 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.767305 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.767399 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.767627 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.767732 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.767941 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.768041 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.768260 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.768355 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.768572 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.768676 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.768904 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.769000 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.769224 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.769345 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.769534 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.769634 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.769844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.769939 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.770154 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.770250 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.770781 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.770899 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.771097 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.771200 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.771442 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.771548 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.771783 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.772451 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.772673 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.772821 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.773071 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.773195 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.773310 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.773523 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.773676 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.773821 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.773964 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.774121 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.774273 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.774433 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.774576 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.774730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.774881 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.775037 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.775193 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.775345 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.775495 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.775645 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.775794 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.775982 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.776129 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.776304 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.776457 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.776609 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.776760 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.776964 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.777108 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.777264 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.777416 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.777566 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.777725 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.777868 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.778020 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.778186 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.778332 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.778508 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.778669 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.778821 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.778971 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.779114 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.779289 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.779430 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.779605 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.779724 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.779858 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.780041 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.780194 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.780351 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.780516 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.780677 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.780842 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.780994 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.781159 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.781308 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.781495 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.781622 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.781827 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.781944 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.782152 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.782264 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.782514 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.782652 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.782904 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.783009 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.783226 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.783348 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.783541 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.783649 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.783850 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.783957 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.784168 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.784265 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.784478 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.784574 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.784788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.784891 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.785104 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.785207 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.785428 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.785522 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.785747 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.785841 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.786056 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.786167 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.786373 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.786501 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.786709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.786821 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.787021 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.787127 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.787333 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.787436 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.787695 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.787809 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.788006 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.788214 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.788355 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.788551 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.788647 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.788873 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.788977 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.789207 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.789309 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.789533 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.789636 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.789845 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.789941 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.790157 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.790253 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.790490 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.790601 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.790803 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.790905 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.791149 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.791245 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.791458 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.791566 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.791773 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.791867 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.792089 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.792187 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.792437 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.792541 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.792759 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.792889 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.793075 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.793226 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.793397 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.793509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.793719 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.793835 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.794029 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.794125 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.794351 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.794517 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.794694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.794797 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.795013 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.795108 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.795329 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.795439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.795641 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.795740 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.795969 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.796064 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.796282 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.796378 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.796597 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.796705 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.796908 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.797011 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.797224 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.797330 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.797539 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.797635 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.797855 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.797950 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.798165 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.798265 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.798502 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.798611 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.798820 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.798924 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.799136 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.799239 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.799449 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.799579 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.799762 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.799857 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.800079 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.800180 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.800391 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.800492 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.800706 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.800801 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.801014 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.801160 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.801325 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.801432 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.801640 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.801742 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.801955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.802064 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.802267 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.802376 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.802621 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.802718 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.802940 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.803056 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.803274 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.803458 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.803591 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.803883 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.804066 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.804218 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.804390 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.804547 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.804705 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.804876 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.805145 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.805241 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.805472 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.805568 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.805792 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.805887 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.806104 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.806207 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.806442 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.806554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.806763 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.806866 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.807086 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.807188 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.807407 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.807505 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.807721 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.807949 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.808147 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.808289 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.808467 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.808599 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.808785 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.808920 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.809102 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.809245 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.809413 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.809569 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.809715 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.809891 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.810028 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.810212 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.810361 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.810562 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.810699 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.810884 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.811011 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.811205 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.811323 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.811634 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.811730 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.811950 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.812047 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.812277 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.812380 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.812626 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.812729 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.813015 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.813134 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.813279 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.813413 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.813605 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.813708 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.813933 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.814090 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.814306 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.814404 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.814659 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.814756 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.814977 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.815080 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.815304 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.815398 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.815613 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.815707 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.815934 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.816030 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.816251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.816346 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.816567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.816669 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.816891 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.816995 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.817206 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.817301 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.817524 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.817618 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.817832 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.817935 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.818150 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.818253 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.818498 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.818619 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.819356 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.819474 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.819697 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.819985 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.820137 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.820342 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.820438 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.820667 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.820762 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.820994 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.821097 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.821356 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.821526 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.821693 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.821852 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.822008 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.822196 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.822323 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.822565 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.822675 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.822902 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.823013 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.823245 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.823353 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.823545 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.823650 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.823881 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.823998 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.824200 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.824314 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.824515 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.824610 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.824834 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.824929 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.825143 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.825239 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.825454 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.825555 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.825784 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.825892 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.826101 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.826195 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.826415 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.826574 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.826763 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.826867 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.827079 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.827180 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.827409 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.827628 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.827724 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.827996 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.828100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.828326 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.828462 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.828646 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.828748 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.828960 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.829063 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.829271 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.829374 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.829622 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.829726 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.829934 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.830038 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.830260 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.830364 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.830615 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.830721 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.830948 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.831051 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.831263 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.831364 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.831579 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.831685 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.831897 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.832001 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.832220 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.832315 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.832542 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.832716 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.832861 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.832957 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.833172 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.833321 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.833486 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.833582 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.833803 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.833908 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.834116 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.834245 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.835001 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.835140 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.835341 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.835498 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.835667 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.835820 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.835984 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.836140 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.836302 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.836454 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.836620 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.836767 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.836938 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.837100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.837261 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.837415 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.837579 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.837747 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.837900 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.838064 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.838217 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.838376 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.838572 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.838700 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.838888 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.838992 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.839209 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.839344 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.839573 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.839680 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.839913 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.840079 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.840227 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.840324 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.840530 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.840747 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.840899 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.841049 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.841194 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.841337 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.841488 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.841637 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.841790 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.841888 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.842112 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.842214 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.842493 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.842594 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.842820 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.842914 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.843161 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.843421 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.843564 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.843707 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.843846 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.844038 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.844142 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.844381 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.844491 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.844701 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.844803 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.845028 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.845139 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.845345 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.845564 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.845669 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.845899 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.845995 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.846225 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.846335 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.846570 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.846668 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.846891 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.846988 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.847211 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.847316 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.847530 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.847634 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.847847 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.847941 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.848161 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.848257 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.848476 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.848570 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.848789 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.848894 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.849123 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.849227 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.849448 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.849544 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.849778 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.849881 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.850119 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.850311 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.850453 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.850664 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.850811 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.850980 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.851142 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.851304 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.851469 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.851628 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.851795 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.851993 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.852121 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.852317 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.852441 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.852633 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.852761 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.852956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.853081 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.853279 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.853385 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.853629 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.853743 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.853916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.854020 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.854233 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.854329 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.854576 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.854694 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.854900 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.855188 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.855283 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.855518 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.855625 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.855831 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.855927 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.856158 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.856252 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.856476 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.856579 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.856810 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.856946 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.857136 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.857233 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.857454 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.857557 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.857772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.857866 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.858094 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.858197 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.858457 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.858648 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.858811 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.858956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.859153 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.859296 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.859497 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.859631 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.859815 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.859964 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.860133 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.860289 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.860453 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.860616 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.860774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.860953 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.861104 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.861269 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.861426 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.861582 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.861742 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.861901 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.862056 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.862220 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.862375 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.862557 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.862716 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.862889 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.863030 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.863208 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.863353 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.863518 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.863643 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.863849 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.863961 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.864166 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.864273 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.864560 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.864710 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.864872 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.865068 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.865172 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.865392 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.865507 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.865751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.865913 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.866094 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.866244 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.866440 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.866589 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.866756 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.866908 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.867090 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.867227 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.867408 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.867544 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.867722 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.867859 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.868047 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.868204 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.868366 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.868553 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.868681 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.868882 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.869041 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.869218 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.869326 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.869545 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.869649 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.869878 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.869974 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.870197 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.870345 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.870527 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.870636 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.870865 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.870971 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.871178 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.871281 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.871491 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.871586 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.871804 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.871946 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.872123 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.872218 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.872434 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.872530 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.872748 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.872891 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.873061 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.873163 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.873373 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.873477 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.873762 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.873870 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.874002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.874105 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.874319 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.874447 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.874653 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.874751 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.874971 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.875075 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.875283 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.875390 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.875599 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.875739 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.875953 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.876047 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.876274 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.876378 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.876588 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.876690 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.876899 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.876997 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.877222 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.877327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.877542 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.877638 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.877859 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.877954 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.878178 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.878274 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.878520 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.878620 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.878844 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.878938 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.879182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.879278 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.879524 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.879723 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.879830 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.880073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.880171 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.880404 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.880500 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.880750 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.880845 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.881092 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.881202 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.882006 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.882102 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.882377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.882502 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.882707 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.882806 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.883033 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.883130 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.883353 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.883449 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.883606 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 12:32:29.883708 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.883977 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.884297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.884617 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.884935 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.885253 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.885571 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.885887 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.886202 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.886544 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.886863 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.887177 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.887500 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.887847 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.888172 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.888500 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.888822 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.889153 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.889464 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.889781 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.890098 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.891025 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.891025 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.891220 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.891395 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.891707 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.892223 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.892545 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.892872 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.893200 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.893519 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.893852 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.894184 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.894523 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.894853 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.895171 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.895768 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.896117 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.896459 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.896794 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.897157 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.897492 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.897785 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.898103 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.898439 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.898771 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.899084 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.899401 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.899717 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.900031 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.900342 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.900655 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.900964 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.901283 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.901589 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.901897 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.902206 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.902539 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.902852 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.903160 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.903474 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.903786 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.904141 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.904400 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.904715 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.905025 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.905363 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.905704 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.906025 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.906355 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.906700 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.907031 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.907348 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.907677 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.908008 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.908330 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.908644 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.908981 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.909300 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.909618 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.909935 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.910251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.910590 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.910908 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.911240 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.911575 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.911887 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.912234 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.913053 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.913379 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.913701 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.914017 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.914355 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.914695 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.915011 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.915332 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.915648 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.915964 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.916285 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.916604 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.916941 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.917274 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.917589 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.917921 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.918253 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.918628 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.918946 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.919297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.919635 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.919957 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.920276 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.920590 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 12:32:29.920837 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 12:32:29.946561 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO dbcounter [None req-f9f6ceee-774a-49e1-ba65-baec97ccfc3f None None] Registered counter for database nova_api Jun 29 12:32:29.966786 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_db.sqlalchemy.engines [None req-f9f6ceee-774a-49e1-ba65-baec97ccfc3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124316) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 12:32:29.973288 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writer thread running {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 12:32:29.983184 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO dbcounter [None req-b35df3df-7a22-4fc0-9876-5ad34cda987d None None] Registered counter for database nova_api Jun 29 12:32:30.003488 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_db.sqlalchemy.engines [None req-b35df3df-7a22-4fc0-9876-5ad34cda987d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124317) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 12:32:30.010062 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writer thread running {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 12:32:30.030753 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.context [None req-f9f6ceee-774a-49e1-ba65-baec97ccfc3f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),644b0361-1506-422f-bdf1-8cea2d80e866(cell1) {{(pid=124316) load_cells /opt/stack/nova/nova/context.py:464}} Jun 29 12:32:30.034891 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f9f6ceee-774a-49e1-ba65-baec97ccfc3f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:32:30.036471 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f9f6ceee-774a-49e1-ba65-baec97ccfc3f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:32:30.037284 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f9f6ceee-774a-49e1-ba65-baec97ccfc3f None None] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:32:30.040008 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f9f6ceee-774a-49e1-ba65-baec97ccfc3f None None] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:32:30.042004 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO dbcounter [None req-f9f6ceee-774a-49e1-ba65-baec97ccfc3f None None] Registered counter for database nova_cell0 Jun 29 12:32:30.046058 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO dbcounter [None req-f9f6ceee-774a-49e1-ba65-baec97ccfc3f None None] Registered counter for database nova_cell1 Jun 29 12:32:30.053946 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_db.sqlalchemy.engines [None req-f9f6ceee-774a-49e1-ba65-baec97ccfc3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124316) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 12:32:30.056422 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_db.sqlalchemy.engines [None req-f9f6ceee-774a-49e1-ba65-baec97ccfc3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124316) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 12:32:30.061945 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writer thread running {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 12:32:30.064124 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writer thread running {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 12:32:30.066579 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.context [None req-b35df3df-7a22-4fc0-9876-5ad34cda987d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),644b0361-1506-422f-bdf1-8cea2d80e866(cell1) {{(pid=124317) load_cells /opt/stack/nova/nova/context.py:464}} Jun 29 12:32:30.070755 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b35df3df-7a22-4fc0-9876-5ad34cda987d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:32:30.072337 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b35df3df-7a22-4fc0-9876-5ad34cda987d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:32:30.073143 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b35df3df-7a22-4fc0-9876-5ad34cda987d None None] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:32:30.075129 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b35df3df-7a22-4fc0-9876-5ad34cda987d None None] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:32:30.077126 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO dbcounter [None req-b35df3df-7a22-4fc0-9876-5ad34cda987d None None] Registered counter for database nova_cell0 Jun 29 12:32:30.081229 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO dbcounter [None req-b35df3df-7a22-4fc0-9876-5ad34cda987d None None] Registered counter for database nova_cell1 Jun 29 12:32:30.088776 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_db.sqlalchemy.engines [None req-b35df3df-7a22-4fc0-9876-5ad34cda987d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124317) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 12:32:30.090494 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_db.sqlalchemy.engines [None req-b35df3df-7a22-4fc0-9876-5ad34cda987d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124317) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 12:32:30.096269 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writer thread running {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 12:32:30.215824 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO dbcounter [None req-f9f6ceee-774a-49e1-ba65-baec97ccfc3f None None] Registered counter for database nova_cell0 Jun 29 12:32:30.222388 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_db.sqlalchemy.engines [None req-f9f6ceee-774a-49e1-ba65-baec97ccfc3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124316) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 12:32:30.227370 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writer thread running {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 12:32:30.242806 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writer thread running {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 12:32:30.252935 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO dbcounter [None req-b35df3df-7a22-4fc0-9876-5ad34cda987d None None] Registered counter for database nova_cell0 Jun 29 12:32:30.259959 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_db.sqlalchemy.engines [None req-b35df3df-7a22-4fc0-9876-5ad34cda987d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124317) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 12:32:30.264607 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writer thread running {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 12:32:30.550909 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: WARNING keystonemiddleware.auth_token [None req-f9f6ceee-774a-49e1-ba65-baec97ccfc3f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 12:32:30.558335 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: WARNING keystonemiddleware.auth_token [None req-f9f6ceee-774a-49e1-ba65-baec97ccfc3f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 12:32:30.585946 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: WARNING keystonemiddleware.auth_token [None req-b35df3df-7a22-4fc0-9876-5ad34cda987d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 12:32:30.593308 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: WARNING keystonemiddleware.auth_token [None req-b35df3df-7a22-4fc0-9876-5ad34cda987d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 12:32:30.906944 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: WARNING keystonemiddleware.auth_token [None req-f9f6ceee-774a-49e1-ba65-baec97ccfc3f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 12:32:30.913391 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: WARNING keystonemiddleware.auth_token [None req-f9f6ceee-774a-49e1-ba65-baec97ccfc3f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 12:32:30.918782 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ebe12469c0 pid: 124316 (default app) Jun 29 12:32:30.939189 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: WARNING keystonemiddleware.auth_token [None req-b35df3df-7a22-4fc0-9876-5ad34cda987d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 12:32:30.945256 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: WARNING keystonemiddleware.auth_token [None req-b35df3df-7a22-4fc0-9876-5ad34cda987d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 12:32:30.950801 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ebe12469c0 pid: 124317 (default app) Jun 29 12:33:12.266853 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=3 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:33:12.269446 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=3 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:33:12.271498 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=3 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:33:12.273086 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=3 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:33:12.275480 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=3 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:33:12.276346 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=3 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:33:12.278726 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=3 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:33:12.281202 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=3 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:33:13.643844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9c273f49-5c94-4cbe-935b-b2f5a0f6b595 tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] Action: 'create', calling method: .version_select at 0x7fdb0895a3a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-172684551", "metadata": {"Type": "work"}}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:33:13.689221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9c273f49-5c94-4cbe-935b-b2f5a0f6b595 tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] Request method failure captured: Jun 29 12:33:13.689221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 29 12:33:13.689221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:33:13.689221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:33:13.689221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:33:13.689221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 121 Jun 29 12:33:13.689221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:33:13.689221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:33:13.689221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:33:13.689221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:33:13.689221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEaIMzbNojhSAGsU-QyqK2BzTHvkV27wJfSpXXiyZ7WPFIHDOzoesco4MasMYlnjhRYzojQIjjbu9lJfOSkLmAZHCMi1DQ031EiwENOQyKBEvRZHkwUkyI_jEPd6A61qeIXg9vP-lmiZg-evWcuJQ31DrPaPV8lxqGUMvVHUFlR6aSk Jun 29 12:33:13.689221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:33:13.689221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:33:13.689221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:33:13.689221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:33:13.689221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:33:13.689221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:33:13.689221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: c8efd9db53c14bf69dc0ebd8ebac75fc Jun 29 12:33:13.689221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-VolumesNegativeTest-1738211914 Jun 29 12:33:13.689221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:33:13.689221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:33:13.691057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c8efd9db53c14bf69dc0ebd8ebac75fc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c8efd9db53c14bf69dc0ebd8ebac75fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c8efd9db53c14bf69dc0ebd8ebac75fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c8efd9db53c14bf69dc0ebd8ebac75fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:33:13.691057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-VolumesNegativeTest-1738211914 Jun 29 12:33:13.691057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: c8efd9db53c14bf69dc0ebd8ebac75fc Jun 29 12:33:13.691057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-VolumesNegativeTest-1738211914 Jun 29 12:33:13.691057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-VolumesNegativeTest-1738211914-project Jun 29 12:33:13.691057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:33:13.691057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:33:13.691057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: 08d02203c5654d71853045704fb0d914 Jun 29 12:33:13.691057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-VolumesNegativeTest-1738211914-project Jun 29 12:33:13.691057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Jun 29 12:33:13.691057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-172684551", "metadata": {"Type": "work"}}} Jun 29 12:33:13.691057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: Jun 29 12:33:13.691057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 29 12:33:13.691936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-172684551', 'metadata': {'Type': 'work'}}}} Jun 29 12:33:13.691936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:33:13.691936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:33:13.691936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 29 12:33:13.691936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 29 12:33:13.691936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 29 12:33:13.691936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise error Jun 29 12:33:13.691936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 29 12:33:13.691936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:13.691936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 29 12:33:13.691936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 29 12:33:13.691936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:13.691936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 29 12:33:13.691936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi '#$%' Jun 29 12:33:13.691936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:13.691936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:33:13.691936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:13.691936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:33:13.691936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:33:13.691936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:33:13.691936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:33:13.691936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:33:13.693433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 12:33:13.693433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 12:33:13.693433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:33:13.693433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:33:13.693433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 29 12:33:13.693433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 29 12:33:13.693433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 29 12:33:13.693433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 29 12:33:13.693433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 29 12:33:13.693433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 29 12:33:13.693433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 29 12:33:13.693433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:13.693433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:33:13.693433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:13.693433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:33:13.693433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:33:13.693433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:33:13.693433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 29 12:33:13.693433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 29 12:33:13.695167 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 29 12:33:13.695167 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:13.695167 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9c273f49-5c94-4cbe-935b-b2f5a0f6b595 tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:33:13.695167 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-9c273f49-5c94-4cbe-935b-b2f5a0f6b595 tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.423294 Jun 29 12:33:13.699336 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1155 bytes} [Wed Jun 29 12:33:12 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1432 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 12:33:13.712858 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-18e9b38b-0077-4b5c-9dd1-c7eaded68e95 tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] Action: 'create', calling method: .version_select at 0x7fdb08904700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-464256195", "metadata": {"Type": "work"}}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:33:13.726343 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-18e9b38b-0077-4b5c-9dd1-c7eaded68e95 tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] Request method failure captured: Jun 29 12:33:13.726343 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 29 12:33:13.726343 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:33:13.726343 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:33:13.726343 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:33:13.726343 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 119 Jun 29 12:33:13.726343 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:33:13.726343 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:33:13.726343 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:33:13.726343 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:33:13.726343 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEaIMzbNojhSAGsU-QyqK2BzTHvkV27wJfSpXXiyZ7WPFIHDOzoesco4MasMYlnjhRYzojQIjjbu9lJfOSkLmAZHCMi1DQ031EiwENOQyKBEvRZHkwUkyI_jEPd6A61qeIXg9vP-lmiZg-evWcuJQ31DrPaPV8lxqGUMvVHUFlR6aSk Jun 29 12:33:13.726343 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:33:13.726343 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:33:13.726343 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:33:13.726343 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:33:13.726343 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:33:13.726343 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:33:13.726343 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: c8efd9db53c14bf69dc0ebd8ebac75fc Jun 29 12:33:13.726343 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-VolumesNegativeTest-1738211914 Jun 29 12:33:13.726343 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:33:13.726343 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:33:13.727717 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c8efd9db53c14bf69dc0ebd8ebac75fc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c8efd9db53c14bf69dc0ebd8ebac75fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c8efd9db53c14bf69dc0ebd8ebac75fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c8efd9db53c14bf69dc0ebd8ebac75fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:33:13.727717 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-VolumesNegativeTest-1738211914 Jun 29 12:33:13.727717 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: c8efd9db53c14bf69dc0ebd8ebac75fc Jun 29 12:33:13.727717 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-VolumesNegativeTest-1738211914 Jun 29 12:33:13.727717 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-VolumesNegativeTest-1738211914-project Jun 29 12:33:13.727717 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:33:13.727717 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:33:13.727717 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: 08d02203c5654d71853045704fb0d914 Jun 29 12:33:13.727717 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-VolumesNegativeTest-1738211914-project Jun 29 12:33:13.727717 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Jun 29 12:33:13.727717 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-464256195", "metadata": {"Type": "work"}}} Jun 29 12:33:13.727717 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: Jun 29 12:33:13.727717 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 29 12:33:13.728475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-464256195', 'metadata': {'Type': 'work'}}}} Jun 29 12:33:13.728475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:33:13.728475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:33:13.728475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 29 12:33:13.728475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 29 12:33:13.728475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 29 12:33:13.728475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise error Jun 29 12:33:13.728475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 29 12:33:13.728475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:13.728475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 29 12:33:13.728475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 29 12:33:13.728475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:13.728475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 29 12:33:13.728475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi '0' Jun 29 12:33:13.728475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:13.728475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:33:13.728475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:13.728475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:33:13.728475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:33:13.728475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:33:13.728475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:33:13.728475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:33:13.729763 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 12:33:13.729763 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 12:33:13.729763 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:33:13.729763 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:33:13.729763 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 29 12:33:13.729763 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 29 12:33:13.729763 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 29 12:33:13.729763 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 29 12:33:13.729763 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 29 12:33:13.729763 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 29 12:33:13.729763 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 29 12:33:13.729763 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:13.729763 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:33:13.729763 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:13.729763 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:33:13.729763 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:33:13.729763 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:33:13.729763 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 29 12:33:13.729763 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 29 12:33:13.730919 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 29 12:33:13.730919 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:13.735357 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-18e9b38b-0077-4b5c-9dd1-c7eaded68e95 tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:33:13.736486 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-18e9b38b-0077-4b5c-9dd1-c7eaded68e95 tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.034502 Jun 29 12:33:13.744530 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 2/2] 10.222.0.52 () {60 vars in 1155 bytes} [Wed Jun 29 12:33:13 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 12:33:13.752186 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-620aedd6-6ec1-4550-8488-8a869b8a0c87 tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] Action: 'create', calling method: .version_select at 0x7fdb0895a700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-876742532", "metadata": {"Type": "work"}}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:33:13.761788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-620aedd6-6ec1-4550-8488-8a869b8a0c87 tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] Request method failure captured: Jun 29 12:33:13.761788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 29 12:33:13.761788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:33:13.761788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:33:13.761788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:33:13.761788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 118 Jun 29 12:33:13.761788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:33:13.761788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:33:13.761788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:33:13.761788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:33:13.761788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEaIMzbNojhSAGsU-QyqK2BzTHvkV27wJfSpXXiyZ7WPFIHDOzoesco4MasMYlnjhRYzojQIjjbu9lJfOSkLmAZHCMi1DQ031EiwENOQyKBEvRZHkwUkyI_jEPd6A61qeIXg9vP-lmiZg-evWcuJQ31DrPaPV8lxqGUMvVHUFlR6aSk Jun 29 12:33:13.761788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:33:13.761788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:33:13.761788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:33:13.761788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:33:13.761788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:33:13.761788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:33:13.761788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: c8efd9db53c14bf69dc0ebd8ebac75fc Jun 29 12:33:13.761788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-VolumesNegativeTest-1738211914 Jun 29 12:33:13.761788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:33:13.761788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:33:13.763206 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c8efd9db53c14bf69dc0ebd8ebac75fc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c8efd9db53c14bf69dc0ebd8ebac75fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c8efd9db53c14bf69dc0ebd8ebac75fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c8efd9db53c14bf69dc0ebd8ebac75fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:33:13.763206 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-VolumesNegativeTest-1738211914 Jun 29 12:33:13.763206 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: c8efd9db53c14bf69dc0ebd8ebac75fc Jun 29 12:33:13.763206 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-VolumesNegativeTest-1738211914 Jun 29 12:33:13.763206 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-VolumesNegativeTest-1738211914-project Jun 29 12:33:13.763206 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:33:13.763206 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:33:13.763206 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: 08d02203c5654d71853045704fb0d914 Jun 29 12:33:13.763206 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-VolumesNegativeTest-1738211914-project Jun 29 12:33:13.763206 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Jun 29 12:33:13.763206 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-876742532", "metadata": {"Type": "work"}}} Jun 29 12:33:13.763206 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: Jun 29 12:33:13.763206 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 29 12:33:13.763970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-876742532', 'metadata': {'Type': 'work'}}}} Jun 29 12:33:13.763970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:33:13.763970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:33:13.763970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 29 12:33:13.763970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 29 12:33:13.763970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 29 12:33:13.763970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise error Jun 29 12:33:13.763970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 29 12:33:13.763970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:13.763970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 29 12:33:13.763970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 29 12:33:13.763970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:13.763970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 29 12:33:13.763970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi '' Jun 29 12:33:13.763970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:13.763970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:33:13.763970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:13.763970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:33:13.763970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:33:13.763970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:33:13.763970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:33:13.763970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:33:13.765243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 12:33:13.765243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 12:33:13.765243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:33:13.765243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:33:13.765243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 29 12:33:13.765243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 29 12:33:13.765243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 29 12:33:13.765243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 29 12:33:13.765243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 29 12:33:13.765243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 29 12:33:13.765243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 29 12:33:13.765243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:13.765243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:33:13.765243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:13.765243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:33:13.765243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:33:13.765243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:33:13.765243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 29 12:33:13.765243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 29 12:33:13.766412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 29 12:33:13.766412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:13.769363 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-620aedd6-6ec1-4550-8488-8a869b8a0c87 tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:33:13.774278 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-620aedd6-6ec1-4550-8488-8a869b8a0c87 tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.027126 Jun 29 12:33:13.775940 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 3/3] 10.222.0.52 () {60 vars in 1155 bytes} [Wed Jun 29 12:33:13 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 12:33:13.847188 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ff9f2098-3e31-4a58-88b4-d2385d069c45 tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] Calling method '.version_select at 0x7fdb08886430>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:13.920064 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fd7e542f-5bef-4fd7-be12-658d63e11c66 tempest-VolumesGetTestJSON-1569035333 tempest-VolumesGetTestJSON-1569035333-project] Action: 'create', calling method: .version_select at 0x7fdb0895a3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-221154609", "metadata": {"Type": "work"}}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:33:14.115777 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-ff9f2098-3e31-4a58-88b4-d2385d069c45 tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] HTTP exception thrown: Volume tempest-invalid-1187480971 could not be found. Jun 29 12:33:14.136889 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ff9f2098-3e31-4a58-88b4-d2385d069c45 tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] Request method failure captured: Jun 29 12:33:14.136889 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1187480971 HTTP/1.1 Jun 29 12:33:14.136889 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:33:14.136889 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:33:14.136889 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:33:14.136889 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:33:14.136889 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:33:14.136889 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:33:14.136889 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:33:14.136889 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:33:14.136889 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEaIMzbNojhSAGsU-QyqK2BzTHvkV27wJfSpXXiyZ7WPFIHDOzoesco4MasMYlnjhRYzojQIjjbu9lJfOSkLmAZHCMi1DQ031EiwENOQyKBEvRZHkwUkyI_jEPd6A61qeIXg9vP-lmiZg-evWcuJQ31DrPaPV8lxqGUMvVHUFlR6aSk Jun 29 12:33:14.136889 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:33:14.136889 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:33:14.136889 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:33:14.136889 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:33:14.136889 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:33:14.136889 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:33:14.136889 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: c8efd9db53c14bf69dc0ebd8ebac75fc Jun 29 12:33:14.136889 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-VolumesNegativeTest-1738211914 Jun 29 12:33:14.136889 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:33:14.136889 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:33:14.138266 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c8efd9db53c14bf69dc0ebd8ebac75fc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c8efd9db53c14bf69dc0ebd8ebac75fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c8efd9db53c14bf69dc0ebd8ebac75fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c8efd9db53c14bf69dc0ebd8ebac75fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:33:14.138266 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-VolumesNegativeTest-1738211914 Jun 29 12:33:14.138266 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: c8efd9db53c14bf69dc0ebd8ebac75fc Jun 29 12:33:14.138266 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-VolumesNegativeTest-1738211914 Jun 29 12:33:14.138266 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-VolumesNegativeTest-1738211914-project Jun 29 12:33:14.138266 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:33:14.138266 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:33:14.138266 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: 08d02203c5654d71853045704fb0d914 Jun 29 12:33:14.138266 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-VolumesNegativeTest-1738211914-project Jun 29 12:33:14.138266 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: Jun 29 12:33:14.138266 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Volume tempest-invalid-1187480971 could not be found. Jun 29 12:33:14.138266 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': 'tempest-invalid-1187480971'} Jun 29 12:33:14.138266 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:33:14.139446 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:33:14.139446 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 12:33:14.139446 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 12:33:14.139446 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 12:33:14.139446 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 12:33:14.139446 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 12:33:14.139446 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 12:33:14.139446 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 12:33:14.139446 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 12:33:14.139446 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 12:33:14.139446 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 12:33:14.139446 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 12:33:14.139446 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 12:33:14.139446 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 12:33:14.139446 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 12:33:14.139446 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1187480971 could not be found. (HTTP 404) (Request-ID: req-53b76e42-a0a3-491f-b930-4416062270ea) Jun 29 12:33:14.139446 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:14.139446 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:33:14.139446 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:14.140593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:33:14.140593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 29 12:33:14.140593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 29 12:33:14.140593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 12:33:14.140593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 12:33:14.140593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 12:33:14.140593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 12:33:14.140593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 12:33:14.140593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 12:33:14.140593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 12:33:14.140593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 12:33:14.140593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 12:33:14.140593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 12:33:14.140593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 12:33:14.140593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 12:33:14.140593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 12:33:14.140593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 12:33:14.140593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 12:33:14.140593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 12:33:14.141979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 12:33:14.141979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 12:33:14.141979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 12:33:14.141979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 12:33:14.141979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1187480971 could not be found. Jun 29 12:33:14.141979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:14.141979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:33:14.141979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:14.141979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:33:14.141979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:33:14.141979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:33:14.141979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:33:14.141979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:33:14.141979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 12:33:14.141979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 12:33:14.141979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:33:14.141979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:33:14.141979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 29 12:33:14.141979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:33:14.141979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1187480971 could not be found. Jun 29 12:33:14.143194 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:14.143194 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:33:14.143194 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:14.143194 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:33:14.143194 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:33:14.143194 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:33:14.143194 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:33:14.143194 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:33:14.143194 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1187480971 could not be found. Jun 29 12:33:14.143194 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:14.143194 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ff9f2098-3e31-4a58-88b4-d2385d069c45 tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] Returning 404 to user: Volume tempest-invalid-1187480971 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:33:14.143194 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ff9f2098-3e31-4a58-88b4-d2385d069c45 tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1187480971" status: 404 len: 99 microversion: 2.1 time: 0.355453 Jun 29 12:33:14.151626 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 4/4] 10.222.0.52 () {58 vars in 1217 bytes} [Wed Jun 29 12:33:13 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1187480971 => generated 99 bytes in 370 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 29 12:33:14.170518 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-495c2ffe-f7f4-4a47-86a3-dcfcac5e4645 tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008800 Jun 29 12:33:14.172183 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 5/5] 10.222.0.52 () {58 vars in 1139 bytes} [Wed Jun 29 12:33:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 29 12:33:14.194791 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-67cf1baa-5bd4-4013-8a6b-883de5de77a4 tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.018391 Jun 29 12:33:14.195327 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 6/6] 10.222.0.52 () {58 vars in 1136 bytes} [Wed Jun 29 12:33:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 29 12:33:14.205861 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b1e972b7-22bd-4072-bc4f-0c518711c96b tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] Calling method '.version_select at 0x7fdb087b0700>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:14.469679 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-b1e972b7-22bd-4072-bc4f-0c518711c96b tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] HTTP exception thrown: Volume 8346ec03-734f-4583-9d6d-0320ad9a5333 could not be found. Jun 29 12:33:14.473412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b1e972b7-22bd-4072-bc4f-0c518711c96b tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] Request method failure captured: Jun 29 12:33:14.473412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: DELETE /compute/v2.1/os-volumes/8346ec03-734f-4583-9d6d-0320ad9a5333 HTTP/1.1 Jun 29 12:33:14.473412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:33:14.473412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:33:14.473412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:33:14.473412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:33:14.473412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:33:14.473412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:33:14.473412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:33:14.473412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:33:14.473412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEaIMzbNojhSAGsU-QyqK2BzTHvkV27wJfSpXXiyZ7WPFIHDOzoesco4MasMYlnjhRYzojQIjjbu9lJfOSkLmAZHCMi1DQ031EiwENOQyKBEvRZHkwUkyI_jEPd6A61qeIXg9vP-lmiZg-evWcuJQ31DrPaPV8lxqGUMvVHUFlR6aSk Jun 29 12:33:14.473412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:33:14.473412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:33:14.473412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:33:14.473412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:33:14.473412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:33:14.473412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:33:14.473412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: c8efd9db53c14bf69dc0ebd8ebac75fc Jun 29 12:33:14.473412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-VolumesNegativeTest-1738211914 Jun 29 12:33:14.473412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:33:14.473412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:33:14.475303 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c8efd9db53c14bf69dc0ebd8ebac75fc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c8efd9db53c14bf69dc0ebd8ebac75fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c8efd9db53c14bf69dc0ebd8ebac75fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c8efd9db53c14bf69dc0ebd8ebac75fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:33:14.475303 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-VolumesNegativeTest-1738211914 Jun 29 12:33:14.475303 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: c8efd9db53c14bf69dc0ebd8ebac75fc Jun 29 12:33:14.475303 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-VolumesNegativeTest-1738211914 Jun 29 12:33:14.475303 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-VolumesNegativeTest-1738211914-project Jun 29 12:33:14.475303 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:33:14.475303 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:33:14.475303 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: 08d02203c5654d71853045704fb0d914 Jun 29 12:33:14.475303 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-VolumesNegativeTest-1738211914-project Jun 29 12:33:14.475303 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: Jun 29 12:33:14.475303 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Volume 8346ec03-734f-4583-9d6d-0320ad9a5333 could not be found. Jun 29 12:33:14.475303 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': '8346ec03-734f-4583-9d6d-0320ad9a5333'} Jun 29 12:33:14.475303 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:33:14.476426 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:33:14.476426 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 12:33:14.476426 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 12:33:14.476426 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 12:33:14.476426 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 12:33:14.476426 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 12:33:14.476426 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 12:33:14.476426 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 12:33:14.476426 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 12:33:14.476426 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 12:33:14.476426 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 12:33:14.476426 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 12:33:14.476426 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 12:33:14.476426 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 12:33:14.476426 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 12:33:14.476426 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8346ec03-734f-4583-9d6d-0320ad9a5333 could not be found. (HTTP 404) (Request-ID: req-1bae3c68-e669-4c0b-a209-b2aa057a56e6) Jun 29 12:33:14.476426 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:14.476426 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:33:14.476426 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:14.477738 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:33:14.477738 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 29 12:33:14.477738 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 29 12:33:14.477738 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 12:33:14.477738 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 12:33:14.477738 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 12:33:14.477738 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 12:33:14.477738 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 12:33:14.477738 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 12:33:14.477738 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 12:33:14.477738 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 12:33:14.477738 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 12:33:14.477738 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 12:33:14.477738 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 12:33:14.477738 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 12:33:14.477738 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 12:33:14.477738 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 12:33:14.477738 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 12:33:14.477738 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 12:33:14.479082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 12:33:14.479082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 12:33:14.479082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 12:33:14.479082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 12:33:14.479082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8346ec03-734f-4583-9d6d-0320ad9a5333 could not be found. Jun 29 12:33:14.479082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:14.479082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:33:14.479082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:14.479082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:33:14.479082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:33:14.479082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:33:14.479082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:33:14.479082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:33:14.479082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 12:33:14.479082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 12:33:14.479082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:33:14.479082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:33:14.479082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 29 12:33:14.479082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:33:14.480366 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8346ec03-734f-4583-9d6d-0320ad9a5333 could not be found. Jun 29 12:33:14.480366 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:14.480366 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:33:14.480366 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:14.480366 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:33:14.480366 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:33:14.480366 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:33:14.480366 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:33:14.480366 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:33:14.480366 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8346ec03-734f-4583-9d6d-0320ad9a5333 could not be found. Jun 29 12:33:14.480366 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:14.480366 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b1e972b7-22bd-4072-bc4f-0c518711c96b tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] Returning 404 to user: Volume 8346ec03-734f-4583-9d6d-0320ad9a5333 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:33:14.480366 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b1e972b7-22bd-4072-bc4f-0c518711c96b tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/8346ec03-734f-4583-9d6d-0320ad9a5333" status: 404 len: 109 microversion: 2.1 time: 0.274465 Jun 29 12:33:14.483185 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 7/7] 10.222.0.52 () {58 vars in 1247 bytes} [Wed Jun 29 12:33:14 2022] DELETE /compute/v2.1/os-volumes/8346ec03-734f-4583-9d6d-0320ad9a5333 => generated 109 bytes in 283 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:33:14.495742 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-08677060-abaf-4e30-9102-1e9d5935c4ab tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] Calling method '.version_select at 0x7fdb08904f70>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:14.583689 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-08677060-abaf-4e30-9102-1e9d5935c4ab tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] HTTP exception thrown: Volume b31b18c9-6979-4b20-b76e-eee39f346195 could not be found. Jun 29 12:33:14.588568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-08677060-abaf-4e30-9102-1e9d5935c4ab tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] Request method failure captured: Jun 29 12:33:14.588568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/os-volumes/b31b18c9-6979-4b20-b76e-eee39f346195 HTTP/1.1 Jun 29 12:33:14.588568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:33:14.588568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:33:14.588568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:33:14.588568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:33:14.588568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:33:14.588568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:33:14.588568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:33:14.588568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:33:14.588568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEaIMzbNojhSAGsU-QyqK2BzTHvkV27wJfSpXXiyZ7WPFIHDOzoesco4MasMYlnjhRYzojQIjjbu9lJfOSkLmAZHCMi1DQ031EiwENOQyKBEvRZHkwUkyI_jEPd6A61qeIXg9vP-lmiZg-evWcuJQ31DrPaPV8lxqGUMvVHUFlR6aSk Jun 29 12:33:14.588568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:33:14.588568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:33:14.588568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:33:14.588568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:33:14.588568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:33:14.588568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:33:14.588568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: c8efd9db53c14bf69dc0ebd8ebac75fc Jun 29 12:33:14.588568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-VolumesNegativeTest-1738211914 Jun 29 12:33:14.588568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:33:14.588568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:33:14.590104 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c8efd9db53c14bf69dc0ebd8ebac75fc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c8efd9db53c14bf69dc0ebd8ebac75fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c8efd9db53c14bf69dc0ebd8ebac75fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c8efd9db53c14bf69dc0ebd8ebac75fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:33:14.590104 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-VolumesNegativeTest-1738211914 Jun 29 12:33:14.590104 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: c8efd9db53c14bf69dc0ebd8ebac75fc Jun 29 12:33:14.590104 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-VolumesNegativeTest-1738211914 Jun 29 12:33:14.590104 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-VolumesNegativeTest-1738211914-project Jun 29 12:33:14.590104 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:33:14.590104 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:33:14.590104 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: 08d02203c5654d71853045704fb0d914 Jun 29 12:33:14.590104 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-VolumesNegativeTest-1738211914-project Jun 29 12:33:14.590104 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: Jun 29 12:33:14.590104 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Volume b31b18c9-6979-4b20-b76e-eee39f346195 could not be found. Jun 29 12:33:14.590104 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': 'b31b18c9-6979-4b20-b76e-eee39f346195'} Jun 29 12:33:14.590104 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:33:14.591100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:33:14.591100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 12:33:14.591100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 12:33:14.591100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 12:33:14.591100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 12:33:14.591100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 12:33:14.591100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 12:33:14.591100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 12:33:14.591100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 12:33:14.591100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 12:33:14.591100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 12:33:14.591100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 12:33:14.591100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 12:33:14.591100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 12:33:14.591100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 12:33:14.591100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b31b18c9-6979-4b20-b76e-eee39f346195 could not be found. (HTTP 404) (Request-ID: req-7149db06-0dd1-4ada-b2b1-5ff8865f9f9e) Jun 29 12:33:14.591100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:14.591100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:33:14.591100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:14.593568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:33:14.593568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 29 12:33:14.593568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 29 12:33:14.593568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 12:33:14.593568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 12:33:14.593568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 12:33:14.593568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 12:33:14.593568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 12:33:14.593568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 12:33:14.593568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 12:33:14.593568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 12:33:14.593568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 12:33:14.593568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 12:33:14.593568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 12:33:14.593568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 12:33:14.593568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 12:33:14.593568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 12:33:14.593568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 12:33:14.593568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 12:33:14.596345 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 12:33:14.596345 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 12:33:14.596345 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 12:33:14.596345 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 12:33:14.596345 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b31b18c9-6979-4b20-b76e-eee39f346195 could not be found. Jun 29 12:33:14.596345 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:14.596345 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:33:14.596345 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:14.596345 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:33:14.596345 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:33:14.596345 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:33:14.596345 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:33:14.596345 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:33:14.596345 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 12:33:14.596345 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 12:33:14.596345 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:33:14.596345 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:33:14.596345 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 29 12:33:14.596345 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:33:14.599231 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b31b18c9-6979-4b20-b76e-eee39f346195 could not be found. Jun 29 12:33:14.599231 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:14.599231 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:33:14.599231 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:14.599231 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:33:14.599231 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:33:14.599231 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:33:14.599231 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:33:14.599231 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:33:14.599231 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b31b18c9-6979-4b20-b76e-eee39f346195 could not be found. Jun 29 12:33:14.599231 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:33:14.599231 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-08677060-abaf-4e30-9102-1e9d5935c4ab tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] Returning 404 to user: Volume b31b18c9-6979-4b20-b76e-eee39f346195 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:33:14.599231 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-08677060-abaf-4e30-9102-1e9d5935c4ab tempest-VolumesNegativeTest-1738211914 tempest-VolumesNegativeTest-1738211914-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b31b18c9-6979-4b20-b76e-eee39f346195" status: 404 len: 109 microversion: 2.1 time: 0.108436 Jun 29 12:33:14.603494 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 8/8] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 12:33:14 2022] GET /compute/v2.1/os-volumes/b31b18c9-6979-4b20-b76e-eee39f346195 => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:33:15.040639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-fd7e542f-5bef-4fd7-be12-658d63e11c66 tempest-VolumesGetTestJSON-1569035333 tempest-VolumesGetTestJSON-1569035333-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.784337 Jun 29 12:33:15.041282 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 1/9] 10.222.0.52 () {60 vars in 1155 bytes} [Wed Jun 29 12:33:12 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2787 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 29 12:33:15.053387 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8968b674-fd18-4fd4-a873-8ac59cd70e8d tempest-VolumesGetTestJSON-1569035333 tempest-VolumesGetTestJSON-1569035333-project] Calling method '.version_select at 0x7fdb087b0160>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:15.204228 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8968b674-fd18-4fd4-a873-8ac59cd70e8d tempest-VolumesGetTestJSON-1569035333 tempest-VolumesGetTestJSON-1569035333-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/c98a546d-5fd0-4702-a967-dbfeec345a7a" status: 200 len: 352 microversion: 2.1 time: 0.155010 Jun 29 12:33:15.205107 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 9/10] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 12:33:15 2022] GET /compute/v2.1/os-volumes/c98a546d-5fd0-4702-a967-dbfeec345a7a => generated 352 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:33:16.218978 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5d66cd64-d9ef-422a-beba-826bfd0b07f0 tempest-VolumesGetTestJSON-1569035333 tempest-VolumesGetTestJSON-1569035333-project] Calling method '.version_select at 0x7fdb0882f280>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:16.311247 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5d66cd64-d9ef-422a-beba-826bfd0b07f0 tempest-VolumesGetTestJSON-1569035333 tempest-VolumesGetTestJSON-1569035333-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/c98a546d-5fd0-4702-a967-dbfeec345a7a" status: 200 len: 353 microversion: 2.1 time: 0.097637 Jun 29 12:33:16.311803 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 2/11] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 12:33:16 2022] GET /compute/v2.1/os-volumes/c98a546d-5fd0-4702-a967-dbfeec345a7a => generated 353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:33:16.323336 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-24ba7835-8d13-4d96-a485-2d2dc7e8a729 tempest-VolumesGetTestJSON-1569035333 tempest-VolumesGetTestJSON-1569035333-project] Calling method '.version_select at 0x7fdb08904ca0>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:16.439775 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-24ba7835-8d13-4d96-a485-2d2dc7e8a729 tempest-VolumesGetTestJSON-1569035333 tempest-VolumesGetTestJSON-1569035333-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/c98a546d-5fd0-4702-a967-dbfeec345a7a" status: 200 len: 353 microversion: 2.1 time: 0.120064 Jun 29 12:33:16.440343 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 10/12] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 12:33:16 2022] GET /compute/v2.1/os-volumes/c98a546d-5fd0-4702-a967-dbfeec345a7a => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:33:16.459577 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b67a4e62-051e-4280-b683-3266a0a2c9ac tempest-VolumesGetTestJSON-1569035333 tempest-VolumesGetTestJSON-1569035333-project] Calling method '.version_select at 0x7fdb0882f430>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:16.554645 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b67a4e62-051e-4280-b683-3266a0a2c9ac tempest-VolumesGetTestJSON-1569035333 tempest-VolumesGetTestJSON-1569035333-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/c98a546d-5fd0-4702-a967-dbfeec345a7a" status: 202 len: 0 microversion: 2.1 time: 0.099602 Jun 29 12:33:16.555461 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 3/13] 10.222.0.52 () {58 vars in 1247 bytes} [Wed Jun 29 12:33:16 2022] DELETE /compute/v2.1/os-volumes/c98a546d-5fd0-4702-a967-dbfeec345a7a => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:33:16.564846 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4408c8f4-5b6c-4e1b-8ccb-2101ec6ea7fa tempest-VolumesGetTestJSON-1569035333 tempest-VolumesGetTestJSON-1569035333-project] Calling method '.version_select at 0x7fdb087b0670>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:16.627958 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4408c8f4-5b6c-4e1b-8ccb-2101ec6ea7fa tempest-VolumesGetTestJSON-1569035333 tempest-VolumesGetTestJSON-1569035333-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/c98a546d-5fd0-4702-a967-dbfeec345a7a" status: 200 len: 352 microversion: 2.1 time: 0.067719 Jun 29 12:33:16.629582 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 11/14] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 12:33:16 2022] GET /compute/v2.1/os-volumes/c98a546d-5fd0-4702-a967-dbfeec345a7a => generated 352 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:33:17.643003 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-cae6320b-0994-4d36-8080-ba5a646e2302 tempest-VolumesGetTestJSON-1569035333 tempest-VolumesGetTestJSON-1569035333-project] Calling method '.version_select at 0x7fdb0882f9d0>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:17.713732 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-cae6320b-0994-4d36-8080-ba5a646e2302 tempest-VolumesGetTestJSON-1569035333 tempest-VolumesGetTestJSON-1569035333-project] HTTP exception thrown: Volume c98a546d-5fd0-4702-a967-dbfeec345a7a could not be found. Jun 29 12:33:17.719628 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-cae6320b-0994-4d36-8080-ba5a646e2302 tempest-VolumesGetTestJSON-1569035333 tempest-VolumesGetTestJSON-1569035333-project] Request method failure captured: Jun 29 12:33:17.719628 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/os-volumes/c98a546d-5fd0-4702-a967-dbfeec345a7a HTTP/1.1 Jun 29 12:33:17.719628 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept: application/json Jun 29 12:33:17.719628 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jun 29 12:33:17.719628 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Connection: close Jun 29 12:33:17.719628 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jun 29 12:33:17.719628 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jun 29 12:33:17.719628 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Host: 10.222.0.52 Jun 29 12:33:17.719628 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jun 29 12:33:17.719628 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jun 29 12:33:17.719628 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivEaI16YwHE7s7z0Uejjkz1m0OccHoRPJJtCnoLaXxLhdKCOTnNQ5YlXqJ3Pdw2XjmLLUsh-wkx85Dj3MtneP2l7-kLbLDx4yxSIkHOP6-q88sNdMwaJzSIpTIIheAIl4O7pOheQ7Usmc9aJRt1J9Vh4Q_Oh6aibIjb91PEHN-LlKlJc Jun 29 12:33:17.719628 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jun 29 12:33:17.719628 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jun 29 12:33:17.719628 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jun 29 12:33:17.719628 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jun 29 12:33:17.719628 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jun 29 12:33:17.719628 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jun 29 12:33:17.719628 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Id: 6fd787ac66684a5b953f94e1273a75e4 Jun 29 12:33:17.719628 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-VolumesGetTestJSON-1569035333 Jun 29 12:33:17.719628 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jun 29 12:33:17.719628 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jun 29 12:33:17.720862 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6fd787ac66684a5b953f94e1273a75e4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6fd787ac66684a5b953f94e1273a75e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6fd787ac66684a5b953f94e1273a75e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6fd787ac66684a5b953f94e1273a75e4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:33:17.720862 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-VolumesGetTestJSON-1569035333 Jun 29 12:33:17.720862 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Id: 6fd787ac66684a5b953f94e1273a75e4 Jun 29 12:33:17.720862 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-VolumesGetTestJSON-1569035333 Jun 29 12:33:17.720862 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User: tempest-VolumesGetTestJSON-1569035333-project Jun 29 12:33:17.720862 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jun 29 12:33:17.720862 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jun 29 12:33:17.720862 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Id: 39886efe36ce4ac9b55f06dffd54d1a3 Jun 29 12:33:17.720862 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-VolumesGetTestJSON-1569035333-project Jun 29 12:33:17.720862 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: method: Jun 29 12:33:17.720862 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: exception: Volume c98a546d-5fd0-4702-a967-dbfeec345a7a could not be found. Jun 29 12:33:17.720862 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: action_args: {'id': 'c98a546d-5fd0-4702-a967-dbfeec345a7a'} Jun 29 12:33:17.720862 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:33:17.721458 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:33:17.721458 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 12:33:17.721458 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 12:33:17.721458 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 12:33:17.721458 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 12:33:17.721458 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 12:33:17.721458 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 12:33:17.721458 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 12:33:17.721458 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 12:33:17.721458 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 12:33:17.721458 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 12:33:17.721458 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 12:33:17.721458 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 12:33:17.721458 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 12:33:17.721458 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 12:33:17.721458 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c98a546d-5fd0-4702-a967-dbfeec345a7a could not be found. (HTTP 404) (Request-ID: req-196e31f0-87b4-4368-a40b-e298ae8cb0c6) Jun 29 12:33:17.721458 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:33:17.721458 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:33:17.721458 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:33:17.722377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:33:17.722377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 29 12:33:17.722377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 29 12:33:17.722377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 12:33:17.722377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 12:33:17.722377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 12:33:17.722377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 12:33:17.722377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 12:33:17.722377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 12:33:17.722377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 12:33:17.722377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 12:33:17.722377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 12:33:17.722377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 12:33:17.722377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 12:33:17.722377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 12:33:17.722377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 12:33:17.722377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 12:33:17.722377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 12:33:17.722377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 12:33:17.723972 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 12:33:17.723972 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 12:33:17.723972 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 12:33:17.723972 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 12:33:17.723972 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c98a546d-5fd0-4702-a967-dbfeec345a7a could not be found. Jun 29 12:33:17.723972 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:33:17.723972 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:33:17.723972 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:33:17.723972 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:33:17.723972 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:33:17.723972 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:33:17.723972 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:33:17.723972 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:33:17.723972 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 12:33:17.723972 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 12:33:17.723972 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:33:17.723972 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:33:17.723972 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 29 12:33:17.723972 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:33:17.724772 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c98a546d-5fd0-4702-a967-dbfeec345a7a could not be found. Jun 29 12:33:17.724772 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:33:17.724772 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:33:17.724772 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:33:17.724772 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:33:17.724772 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:33:17.724772 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:33:17.724772 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:33:17.724772 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:33:17.724772 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c98a546d-5fd0-4702-a967-dbfeec345a7a could not be found. Jun 29 12:33:17.724772 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:33:17.728390 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-cae6320b-0994-4d36-8080-ba5a646e2302 tempest-VolumesGetTestJSON-1569035333 tempest-VolumesGetTestJSON-1569035333-project] Returning 404 to user: Volume c98a546d-5fd0-4702-a967-dbfeec345a7a could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:33:17.729533 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-cae6320b-0994-4d36-8080-ba5a646e2302 tempest-VolumesGetTestJSON-1569035333 tempest-VolumesGetTestJSON-1569035333-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/c98a546d-5fd0-4702-a967-dbfeec345a7a" status: 404 len: 109 microversion: 2.1 time: 0.092429 Jun 29 12:33:17.734814 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 4/15] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 12:33:17 2022] GET /compute/v2.1/os-volumes/c98a546d-5fd0-4702-a967-dbfeec345a7a => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:33:23.460639 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6013353d-1ddd-48c7-9ff6-ef9f6076df3e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Action: 'create', calling method: .version_select at 0x7fdb087b0ee0>, body: {"keypair": {"name": "tempest-keypair-1986434234", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGYpGAmd3fRmtep+/42qhAcv87blFkQ/Dim2CcsvwOFTYPdPDRGWRdWFjeGmPxz60rOp+fZH+29Ff9uvWRUcbfUMlIpbDf5OLzk7ZtqvVr0Hyd37PwSIBJz3URlWIk3aQ=="}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:33:23.589126 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-6013353d-1ddd-48c7-9ff6-ef9f6076df3e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Getting quotas for project 0ed882ae485441db99ccf6109be51b22. Resources: {'key_pairs'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:33:23.599787 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-6013353d-1ddd-48c7-9ff6-ef9f6076df3e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Getting quotas for user 6252d0519ed9421e89710ca5294524c5 and project 0ed882ae485441db99ccf6109be51b22. Resources: {'key_pairs'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:33:23.687581 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6013353d-1ddd-48c7-9ff6-ef9f6076df3e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.934309 Jun 29 12:33:23.690382 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 12/16] 10.222.0.52 () {62 vars in 1199 bytes} [Wed Jun 29 12:33:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 939 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 29 12:33:31.421919 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3dc86eec-8f51-4d7e-bc83-ae2c5654b92b tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-211201718", "imageRef": "70887696-f652-46b0-a5be-bfb400986078", "flavorRef": "452", "networks": [{"uuid": "f0d91924-1f47-49aa-8f3d-957f9bdb1bcf"}]}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:33:31.680894 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-924c1c28-f5f4-4f52-a80b-d6350a83e830 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1153420512", "imageRef": "70887696-f652-46b0-a5be-bfb400986078", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:33:31.688718 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.network.neutron [None req-3dc86eec-8f51-4d7e-bc83-ae2c5654b92b tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] validate_networks() for [('f0d91924-1f47-49aa-8f3d-957f9bdb1bcf', None, None, None, None, None)] {{(pid=124316) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 12:33:31.858011 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.network.neutron [None req-924c1c28-f5f4-4f52-a80b-d6350a83e830 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] validate_networks() for [('07f547a4-09fa-4dfc-8b3c-2afd951b9459', None, None, None, None, None)] {{(pid=124317) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 12:33:33.602083 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-924c1c28-f5f4-4f52-a80b-d6350a83e830 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Flavor limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 12:33:33.602788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-924c1c28-f5f4-4f52-a80b-d6350a83e830 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Image limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 12:33:33.603028 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-924c1c28-f5f4-4f52-a80b-d6350a83e830 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Flavor pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 12:33:33.604048 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-924c1c28-f5f4-4f52-a80b-d6350a83e830 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Image pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 12:33:33.604612 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-924c1c28-f5f4-4f52-a80b-d6350a83e830 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 12:33:33.618010 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-924c1c28-f5f4-4f52-a80b-d6350a83e830 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:33.619374 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-924c1c28-f5f4-4f52-a80b-d6350a83e830 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:33.620448 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-924c1c28-f5f4-4f52-a80b-d6350a83e830 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:33.621080 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-924c1c28-f5f4-4f52-a80b-d6350a83e830 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:33.664258 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-924c1c28-f5f4-4f52-a80b-d6350a83e830 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Getting quotas for project 8be6d4a4e2344e25b7661d69a9e222c8. Resources: {'cores', 'ram', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:33:33.671279 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-924c1c28-f5f4-4f52-a80b-d6350a83e830 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Getting quotas for user 350a57ee307a4419974dcecf37e466e5 and project 8be6d4a4e2344e25b7661d69a9e222c8. Resources: {'cores', 'ram', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:33:33.705080 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-924c1c28-f5f4-4f52-a80b-d6350a83e830 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Going to run 1 instances... {{(pid=124317) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 12:33:33.712253 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-924c1c28-f5f4-4f52-a80b-d6350a83e830 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70887696-f652-46b0-a5be-bfb400986078',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124317) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 12:33:33.839743 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-3dc86eec-8f51-4d7e-bc83-ae2c5654b92b tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Flavor limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 12:33:33.840209 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-3dc86eec-8f51-4d7e-bc83-ae2c5654b92b tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Image limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 12:33:33.840937 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-3dc86eec-8f51-4d7e-bc83-ae2c5654b92b tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Flavor pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 12:33:33.841580 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-3dc86eec-8f51-4d7e-bc83-ae2c5654b92b tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Image pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 12:33:33.842007 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-3dc86eec-8f51-4d7e-bc83-ae2c5654b92b tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 12:33:33.853971 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-924c1c28-f5f4-4f52-a80b-d6350a83e830 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.581165 Jun 29 12:33:33.854841 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 13/17] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 12:33:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 2583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 29 12:33:33.869987 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-018ebc04-9953-4484-8ba7-0c6c9b327c44 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-12245738", "imageRef": "70887696-f652-46b0-a5be-bfb400986078", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "397d642b-81b8-4b71-80dd-1d3a811e873b"}], "security_groups": [{"name": "tempest-securitygroup--1759345164"}], "key_name": "tempest-keypair-1986434234", "user_data": "}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:33:33.882700 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3dc86eec-8f51-4d7e-bc83-ae2c5654b92b tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:33.884203 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3dc86eec-8f51-4d7e-bc83-ae2c5654b92b tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:33.886699 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3dc86eec-8f51-4d7e-bc83-ae2c5654b92b tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:33.888850 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3dc86eec-8f51-4d7e-bc83-ae2c5654b92b tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:33.992815 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-3dc86eec-8f51-4d7e-bc83-ae2c5654b92b tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Getting quotas for project 46f5397c062a4868a0282f7535f84f7a. Resources: {'cores', 'ram', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:33:34.014668 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-3dc86eec-8f51-4d7e-bc83-ae2c5654b92b tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Getting quotas for user 8a232c3292ec4a0abda3a8bc91c5a267 and project 46f5397c062a4868a0282f7535f84f7a. Resources: {'cores', 'ram', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:33:34.056951 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3dc86eec-8f51-4d7e-bc83-ae2c5654b92b tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Going to run 1 instances... {{(pid=124316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 12:33:34.060051 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3dc86eec-8f51-4d7e-bc83-ae2c5654b92b tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70887696-f652-46b0-a5be-bfb400986078',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 12:33:34.162316 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.network.neutron [None req-018ebc04-9953-4484-8ba7-0c6c9b327c44 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] validate_networks() for [('397d642b-81b8-4b71-80dd-1d3a811e873b', None, None, None, None, None)] {{(pid=124317) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 12:33:34.308144 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3dc86eec-8f51-4d7e-bc83-ae2c5654b92b tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.097590 Jun 29 12:33:34.313949 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 5/18] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 12:33:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 3099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 12:33:34.956310 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5f42c95f-bfb4-4ee3-a802-5d231023236c tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Action: 'create', calling method: .version_select at 0x7fdb07e93dc0>, body: {"keypair": {"name": "tempest-keypair-1121858358", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPz607qRE3PMn2ZDgx0lOOqjocvINcjJKaRSAHSbr4LB71DRHU8EW3Qo1IoLwbXtBdubvrY/J533kFSwhwcWiI48XtxzNVDKzVw/sMyOVCpp4wP6WxCnUF0IA5amx5OYTg=="}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:33:35.052394 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-5f42c95f-bfb4-4ee3-a802-5d231023236c tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Getting quotas for project 0f625199b4eb48c98944ea79a90f2841. Resources: {'key_pairs'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:33:35.069439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-5f42c95f-bfb4-4ee3-a802-5d231023236c tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Getting quotas for user a4a30b65a91a4fd89e8b59df670f60ad and project 0f625199b4eb48c98944ea79a90f2841. Resources: {'key_pairs'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:33:35.222030 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5f42c95f-bfb4-4ee3-a802-5d231023236c tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.907365 Jun 29 12:33:35.225471 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 6/19] 10.222.0.52 () {60 vars in 1158 bytes} [Wed Jun 29 12:33:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:33:35.242844 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e187984c-d550-4dae-a586-cfe67c8b6fa5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:35.245437 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e187984c-d550-4dae-a586-cfe67c8b6fa5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:35.505649 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-018ebc04-9953-4484-8ba7-0c6c9b327c44 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Flavor limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 12:33:35.506228 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-018ebc04-9953-4484-8ba7-0c6c9b327c44 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Image limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 12:33:35.506621 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-018ebc04-9953-4484-8ba7-0c6c9b327c44 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Flavor pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 12:33:35.507237 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-018ebc04-9953-4484-8ba7-0c6c9b327c44 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Image pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 12:33:35.507807 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-018ebc04-9953-4484-8ba7-0c6c9b327c44 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 12:33:35.556813 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-018ebc04-9953-4484-8ba7-0c6c9b327c44 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:35.559647 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-018ebc04-9953-4484-8ba7-0c6c9b327c44 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:35.563763 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-018ebc04-9953-4484-8ba7-0c6c9b327c44 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:35.565853 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-018ebc04-9953-4484-8ba7-0c6c9b327c44 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:35.634858 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-018ebc04-9953-4484-8ba7-0c6c9b327c44 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Getting quotas for project 0ed882ae485441db99ccf6109be51b22. Resources: {'cores', 'ram', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:33:35.673974 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-018ebc04-9953-4484-8ba7-0c6c9b327c44 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Getting quotas for user 6252d0519ed9421e89710ca5294524c5 and project 0ed882ae485441db99ccf6109be51b22. Resources: {'cores', 'ram', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:33:35.732350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-018ebc04-9953-4484-8ba7-0c6c9b327c44 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Going to run 1 instances... {{(pid=124317) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 12:33:35.751007 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-018ebc04-9953-4484-8ba7-0c6c9b327c44 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70887696-f652-46b0-a5be-bfb400986078',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124317) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 12:33:35.854814 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e187984c-d550-4dae-a586-cfe67c8b6fa5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:35.880503 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-018ebc04-9953-4484-8ba7-0c6c9b327c44 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.015935 Jun 29 12:33:35.890074 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 14/20] 10.222.0.52 () {62 vars in 1187 bytes} [Wed Jun 29 12:33:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 2027 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 29 12:33:35.905915 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-84a6ac48-d903-41a1-b6b0-5945ecfe8e69 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:35.907583 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e187984c-d550-4dae-a586-cfe67c8b6fa5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1222 microversion: 2.1 time: 0.680977 Jun 29 12:33:35.916435 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 7/21] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:35 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1222 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:35.918804 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-84a6ac48-d903-41a1-b6b0-5945ecfe8e69 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:35.969707 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d775c455-4619-4e15-ad71-cbd5b80f3303 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:35.974581 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d775c455-4619-4e15-ad71-cbd5b80f3303 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:36.150141 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d775c455-4619-4e15-ad71-cbd5b80f3303 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:36.161823 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d775c455-4619-4e15-ad71-cbd5b80f3303 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:36.163754 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d775c455-4619-4e15-ad71-cbd5b80f3303 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:36.173283 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d775c455-4619-4e15-ad71-cbd5b80f3303 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1280 microversion: 2.20 time: 0.254882 Jun 29 12:33:36.174361 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 8/22] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:33:35 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1280 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:33:36.400297 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d680fa7b-bdfc-4a60-a407-a032093b5db9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-813504518", "imageRef": "70887696-f652-46b0-a5be-bfb400986078", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:33:36.507300 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.network.neutron [None req-d680fa7b-bdfc-4a60-a407-a032093b5db9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] validate_networks() for [('07f547a4-09fa-4dfc-8b3c-2afd951b9459', None, None, None, None, None)] {{(pid=124316) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 12:33:36.580955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-84a6ac48-d903-41a1-b6b0-5945ecfe8e69 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:36.618359 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-84a6ac48-d903-41a1-b6b0-5945ecfe8e69 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1214 microversion: 2.1 time: 0.725396 Jun 29 12:33:36.619786 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 15/23] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:35 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1214 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:37.193047 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9d2128e3-4172-459d-b369-c59109d9e38e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:37.194038 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-9d2128e3-4172-459d-b369-c59109d9e38e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:37.222311 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9d2128e3-4172-459d-b369-c59109d9e38e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:37.223682 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9d2128e3-4172-459d-b369-c59109d9e38e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:37.233994 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9d2128e3-4172-459d-b369-c59109d9e38e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:37.239347 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9d2128e3-4172-459d-b369-c59109d9e38e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:37.605302 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-d680fa7b-bdfc-4a60-a407-a032093b5db9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Flavor limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 12:33:37.606366 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-d680fa7b-bdfc-4a60-a407-a032093b5db9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Image limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 12:33:37.607211 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-d680fa7b-bdfc-4a60-a407-a032093b5db9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Flavor pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 12:33:37.607852 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-d680fa7b-bdfc-4a60-a407-a032093b5db9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Image pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 12:33:37.608581 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-d680fa7b-bdfc-4a60-a407-a032093b5db9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 12:33:37.624800 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d680fa7b-bdfc-4a60-a407-a032093b5db9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:37.625725 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d680fa7b-bdfc-4a60-a407-a032093b5db9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:37.626881 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d680fa7b-bdfc-4a60-a407-a032093b5db9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:37.627516 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d680fa7b-bdfc-4a60-a407-a032093b5db9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:37.668699 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-d680fa7b-bdfc-4a60-a407-a032093b5db9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Getting quotas for project 8be6d4a4e2344e25b7661d69a9e222c8. Resources: {'cores', 'ram', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:33:37.684972 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-d680fa7b-bdfc-4a60-a407-a032093b5db9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Getting quotas for user 350a57ee307a4419974dcecf37e466e5 and project 8be6d4a4e2344e25b7661d69a9e222c8. Resources: {'cores', 'ram', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:33:37.688293 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-9d2128e3-4172-459d-b369-c59109d9e38e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:37.719911 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d680fa7b-bdfc-4a60-a407-a032093b5db9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Going to run 1 instances... {{(pid=124316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 12:33:37.725244 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d680fa7b-bdfc-4a60-a407-a032093b5db9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70887696-f652-46b0-a5be-bfb400986078',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 12:33:37.726218 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-9d2128e3-4172-459d-b369-c59109d9e38e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:37.727804 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-9d2128e3-4172-459d-b369-c59109d9e38e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:37.728949 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-9d2128e3-4172-459d-b369-c59109d9e38e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1284 microversion: 2.20 time: 0.540844 Jun 29 12:33:37.740455 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 16/24] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:33:37 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1284 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:33:37.745686 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-11285edd-181f-4b8d-bedc-b89c38a0afec tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:37.748041 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-11285edd-181f-4b8d-bedc-b89c38a0afec tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:37.778371 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-11285edd-181f-4b8d-bedc-b89c38a0afec tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:37.778856 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-11285edd-181f-4b8d-bedc-b89c38a0afec tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:37.779659 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-11285edd-181f-4b8d-bedc-b89c38a0afec tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:37.780096 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-11285edd-181f-4b8d-bedc-b89c38a0afec tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:37.901032 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d680fa7b-bdfc-4a60-a407-a032093b5db9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.510736 Jun 29 12:33:37.901681 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 9/25] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 12:33:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 1512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 29 12:33:37.931974 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4174c08a-2f49-4618-a755-edf394ddf7cf tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:37.932804 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4174c08a-2f49-4618-a755-edf394ddf7cf tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:38.068393 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-11285edd-181f-4b8d-bedc-b89c38a0afec tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:38.104100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-11285edd-181f-4b8d-bedc-b89c38a0afec tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1218 microversion: 2.1 time: 0.349219 Jun 29 12:33:38.120735 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 17/26] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:37 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1218 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:38.242131 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4174c08a-2f49-4618-a755-edf394ddf7cf tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:38.256040 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4174c08a-2f49-4618-a755-edf394ddf7cf tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1221 microversion: 2.1 time: 0.342603 Jun 29 12:33:38.268384 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 10/27] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:37 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1221 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:38.751375 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1dda9c05-40cf-4601-9d74-c202ef2989df tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:38.752586 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1dda9c05-40cf-4601-9d74-c202ef2989df tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:38.764870 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1dda9c05-40cf-4601-9d74-c202ef2989df tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:38.764971 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1dda9c05-40cf-4601-9d74-c202ef2989df tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:38.767096 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1dda9c05-40cf-4601-9d74-c202ef2989df tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:38.767513 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1dda9c05-40cf-4601-9d74-c202ef2989df tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:39.070301 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1dda9c05-40cf-4601-9d74-c202ef2989df tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:39.090582 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1dda9c05-40cf-4601-9d74-c202ef2989df tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:39.092180 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1dda9c05-40cf-4601-9d74-c202ef2989df tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:39.093329 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1dda9c05-40cf-4601-9d74-c202ef2989df tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1340 microversion: 2.20 time: 0.347566 Jun 29 12:33:39.093902 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 18/28] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:33:38 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1340 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:33:39.133339 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3f79e013-7379-4305-a382-0adf85292111 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:39.141607 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3f79e013-7379-4305-a382-0adf85292111 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:39.160965 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3f79e013-7379-4305-a382-0adf85292111 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:39.162218 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3f79e013-7379-4305-a382-0adf85292111 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:39.164351 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3f79e013-7379-4305-a382-0adf85292111 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:39.173896 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3f79e013-7379-4305-a382-0adf85292111 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:39.275590 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8435ab98-0e0d-4c7f-b315-456623547e7e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:39.276215 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8435ab98-0e0d-4c7f-b315-456623547e7e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:39.292037 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8435ab98-0e0d-4c7f-b315-456623547e7e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:39.295437 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8435ab98-0e0d-4c7f-b315-456623547e7e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:39.299806 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8435ab98-0e0d-4c7f-b315-456623547e7e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:39.305401 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8435ab98-0e0d-4c7f-b315-456623547e7e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:39.732585 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8435ab98-0e0d-4c7f-b315-456623547e7e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:39.759083 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8435ab98-0e0d-4c7f-b315-456623547e7e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1225 microversion: 2.1 time: 0.481470 Jun 29 12:33:39.763993 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 19/29] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:39 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1225 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:39.828587 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3f79e013-7379-4305-a382-0adf85292111 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:39.869376 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3f79e013-7379-4305-a382-0adf85292111 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1274 microversion: 2.1 time: 0.739383 Jun 29 12:33:39.888198 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 11/30] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:39 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1274 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:40.116936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0bf9bff5-742f-4a4d-be5d-f1eb9207ddb4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:40.118474 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0bf9bff5-742f-4a4d-be5d-f1eb9207ddb4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:40.150610 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0bf9bff5-742f-4a4d-be5d-f1eb9207ddb4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:40.157576 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0bf9bff5-742f-4a4d-be5d-f1eb9207ddb4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:40.162022 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0bf9bff5-742f-4a4d-be5d-f1eb9207ddb4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:40.165237 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0bf9bff5-742f-4a4d-be5d-f1eb9207ddb4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:40.604841 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0bf9bff5-742f-4a4d-be5d-f1eb9207ddb4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:40.618293 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0bf9bff5-742f-4a4d-be5d-f1eb9207ddb4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:40.625422 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0bf9bff5-742f-4a4d-be5d-f1eb9207ddb4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:40.630532 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0bf9bff5-742f-4a4d-be5d-f1eb9207ddb4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1338 microversion: 2.20 time: 0.520728 Jun 29 12:33:40.648119 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 20/31] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:33:40 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1338 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:33:40.781421 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ae572b71-5c4a-4129-86a4-e2546fe18c37 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:40.781978 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ae572b71-5c4a-4129-86a4-e2546fe18c37 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:40.808206 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ae572b71-5c4a-4129-86a4-e2546fe18c37 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:40.809816 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ae572b71-5c4a-4129-86a4-e2546fe18c37 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:40.815566 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ae572b71-5c4a-4129-86a4-e2546fe18c37 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:40.816041 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ae572b71-5c4a-4129-86a4-e2546fe18c37 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:40.883462 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e679c23d-d4eb-4466-84b3-6c30f97e00d4 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:40.884092 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e679c23d-d4eb-4466-84b3-6c30f97e00d4 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:40.899938 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e679c23d-d4eb-4466-84b3-6c30f97e00d4 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:40.900367 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e679c23d-d4eb-4466-84b3-6c30f97e00d4 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:40.904683 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e679c23d-d4eb-4466-84b3-6c30f97e00d4 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:40.906356 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e679c23d-d4eb-4466-84b3-6c30f97e00d4 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:41.129475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e679c23d-d4eb-4466-84b3-6c30f97e00d4 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:41.139308 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e679c23d-d4eb-4466-84b3-6c30f97e00d4 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1272 microversion: 2.1 time: 0.261359 Jun 29 12:33:41.140087 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 21/32] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:40 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1272 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:41.343410 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ae572b71-5c4a-4129-86a4-e2546fe18c37 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:41.368377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ae572b71-5c4a-4129-86a4-e2546fe18c37 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1279 microversion: 2.1 time: 0.590965 Jun 29 12:33:41.371835 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 12/33] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:40 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1279 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:41.660239 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b454ef60-08b3-46b5-aa96-5e8372c37ff4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:41.661131 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b454ef60-08b3-46b5-aa96-5e8372c37ff4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:41.689508 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b454ef60-08b3-46b5-aa96-5e8372c37ff4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:41.693946 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b454ef60-08b3-46b5-aa96-5e8372c37ff4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:41.706407 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-352678e7-56ee-4707-b1a0-3215ddd9e527 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1402058739", "imageRef": "70887696-f652-46b0-a5be-bfb400986078", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b5a74d9-0a05-4165-ad79-54d13b50c375"}], "security_groups": [{"name": "tempest-securitygroup--1400191379"}], "key_name": "tempest-keypair-1121858358", "user_data": "}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:33:41.711261 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b454ef60-08b3-46b5-aa96-5e8372c37ff4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:41.718323 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b454ef60-08b3-46b5-aa96-5e8372c37ff4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:42.060948 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b454ef60-08b3-46b5-aa96-5e8372c37ff4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:42.087852 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b454ef60-08b3-46b5-aa96-5e8372c37ff4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:42.092388 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b454ef60-08b3-46b5-aa96-5e8372c37ff4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:42.093593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b454ef60-08b3-46b5-aa96-5e8372c37ff4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1338 microversion: 2.20 time: 0.440204 Jun 29 12:33:42.130455 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 22/34] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:33:41 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1338 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:33:42.175943 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6448b2cc-3ed1-4b8e-b783-20aab2dcd5af tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:42.177494 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-6448b2cc-3ed1-4b8e-b783-20aab2dcd5af tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:42.217721 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6448b2cc-3ed1-4b8e-b783-20aab2dcd5af tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:42.219351 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6448b2cc-3ed1-4b8e-b783-20aab2dcd5af tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:42.222154 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6448b2cc-3ed1-4b8e-b783-20aab2dcd5af tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:42.224197 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6448b2cc-3ed1-4b8e-b783-20aab2dcd5af tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:42.352048 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.network.neutron [None req-352678e7-56ee-4707-b1a0-3215ddd9e527 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] validate_networks() for [('7b5a74d9-0a05-4165-ad79-54d13b50c375', None, None, None, None, None)] {{(pid=124316) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 12:33:42.441213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6448b2cc-3ed1-4b8e-b783-20aab2dcd5af tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:42.450442 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6448b2cc-3ed1-4b8e-b783-20aab2dcd5af tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1272 microversion: 2.1 time: 0.290095 Jun 29 12:33:42.455452 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 23/35] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:42 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1272 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:42.482517 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1c508c74-a4a0-445d-9519-c42ea2f55331 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:42.483158 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1c508c74-a4a0-445d-9519-c42ea2f55331 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:42.507231 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1c508c74-a4a0-445d-9519-c42ea2f55331 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:42.507687 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1c508c74-a4a0-445d-9519-c42ea2f55331 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:42.512369 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1c508c74-a4a0-445d-9519-c42ea2f55331 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:42.513186 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1c508c74-a4a0-445d-9519-c42ea2f55331 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:42.796224 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1c508c74-a4a0-445d-9519-c42ea2f55331 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:42.810742 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1c508c74-a4a0-445d-9519-c42ea2f55331 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1279 microversion: 2.1 time: 0.353931 Jun 29 12:33:42.812914 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 24/36] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:42 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1279 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:43.113817 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c3e1c586-85be-4120-a042-00629df04730 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:43.115658 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c3e1c586-85be-4120-a042-00629df04730 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:43.139228 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c3e1c586-85be-4120-a042-00629df04730 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:43.140628 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c3e1c586-85be-4120-a042-00629df04730 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:43.142623 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c3e1c586-85be-4120-a042-00629df04730 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:43.143522 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c3e1c586-85be-4120-a042-00629df04730 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:43.501493 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c3e1c586-85be-4120-a042-00629df04730 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:43.521100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c3e1c586-85be-4120-a042-00629df04730 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:43.531308 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c3e1c586-85be-4120-a042-00629df04730 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:43.541599 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c3e1c586-85be-4120-a042-00629df04730 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1338 microversion: 2.20 time: 0.432834 Jun 29 12:33:43.551399 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 25/37] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:33:43 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1338 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:33:43.558360 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-2cfed108-1e72-4b07-ad17-f710b7417286 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:43.559276 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-2cfed108-1e72-4b07-ad17-f710b7417286 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:43.581273 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2cfed108-1e72-4b07-ad17-f710b7417286 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:43.581730 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2cfed108-1e72-4b07-ad17-f710b7417286 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:43.583239 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2cfed108-1e72-4b07-ad17-f710b7417286 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:43.583596 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2cfed108-1e72-4b07-ad17-f710b7417286 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:44.404930 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2cfed108-1e72-4b07-ad17-f710b7417286 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:44.420779 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-2cfed108-1e72-4b07-ad17-f710b7417286 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1314 microversion: 2.1 time: 0.866919 Jun 29 12:33:44.424402 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 26/38] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:43 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1314 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:44.433787 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9cc9a6ff-3e61-4bfc-a708-715503650737 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:44.451331 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-9cc9a6ff-3e61-4bfc-a708-715503650737 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:44.465020 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9cc9a6ff-3e61-4bfc-a708-715503650737 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:44.467691 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9cc9a6ff-3e61-4bfc-a708-715503650737 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:44.468727 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9cc9a6ff-3e61-4bfc-a708-715503650737 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:44.472081 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9cc9a6ff-3e61-4bfc-a708-715503650737 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:44.680696 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-9cc9a6ff-3e61-4bfc-a708-715503650737 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:44.697199 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-9cc9a6ff-3e61-4bfc-a708-715503650737 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1279 microversion: 2.1 time: 0.264975 Jun 29 12:33:44.699596 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 27/39] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:44 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1279 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:44.723220 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-046fe3f3-916e-4c2d-b236-bf6c17646c2c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:44.724222 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-046fe3f3-916e-4c2d-b236-bf6c17646c2c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:44.746220 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-046fe3f3-916e-4c2d-b236-bf6c17646c2c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:44.747192 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-046fe3f3-916e-4c2d-b236-bf6c17646c2c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:44.748347 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-046fe3f3-916e-4c2d-b236-bf6c17646c2c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:44.749333 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-046fe3f3-916e-4c2d-b236-bf6c17646c2c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:44.875072 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-046fe3f3-916e-4c2d-b236-bf6c17646c2c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:44.885937 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-046fe3f3-916e-4c2d-b236-bf6c17646c2c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:44.887493 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-046fe3f3-916e-4c2d-b236-bf6c17646c2c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:44.895774 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-046fe3f3-916e-4c2d-b236-bf6c17646c2c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1338 microversion: 2.20 time: 0.193390 Jun 29 12:33:44.898607 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 28/40] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:33:44 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1338 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:33:45.040015 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-352678e7-56ee-4707-b1a0-3215ddd9e527 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Flavor limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 12:33:45.040613 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-352678e7-56ee-4707-b1a0-3215ddd9e527 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Image limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 12:33:45.041002 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-352678e7-56ee-4707-b1a0-3215ddd9e527 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Flavor pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 12:33:45.041463 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-352678e7-56ee-4707-b1a0-3215ddd9e527 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Image pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 12:33:45.042070 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-352678e7-56ee-4707-b1a0-3215ddd9e527 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 12:33:45.077810 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-352678e7-56ee-4707-b1a0-3215ddd9e527 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:45.086215 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-352678e7-56ee-4707-b1a0-3215ddd9e527 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:45.089363 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-352678e7-56ee-4707-b1a0-3215ddd9e527 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:45.093107 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-352678e7-56ee-4707-b1a0-3215ddd9e527 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:45.127363 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-352678e7-56ee-4707-b1a0-3215ddd9e527 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Getting quotas for project 0f625199b4eb48c98944ea79a90f2841. Resources: {'cores', 'ram', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:33:45.133225 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-352678e7-56ee-4707-b1a0-3215ddd9e527 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Getting quotas for user a4a30b65a91a4fd89e8b59df670f60ad and project 0f625199b4eb48c98944ea79a90f2841. Resources: {'cores', 'ram', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:33:45.154804 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-352678e7-56ee-4707-b1a0-3215ddd9e527 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Going to run 1 instances... {{(pid=124316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 12:33:45.168265 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-352678e7-56ee-4707-b1a0-3215ddd9e527 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70887696-f652-46b0-a5be-bfb400986078',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 12:33:45.323657 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-352678e7-56ee-4707-b1a0-3215ddd9e527 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.621020 Jun 29 12:33:45.339095 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e50b081c-71e1-48fb-97ba-6408f3f6cad6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:45.340068 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e50b081c-71e1-48fb-97ba-6408f3f6cad6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:45.345101 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 13/41] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 12:33:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 3644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 29 12:33:45.442530 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-91b78b45-47da-42f0-94e6-4c3b33d9bf50 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:45.443608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-91b78b45-47da-42f0-94e6-4c3b33d9bf50 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:45.466738 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-91b78b45-47da-42f0-94e6-4c3b33d9bf50 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:45.471072 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-91b78b45-47da-42f0-94e6-4c3b33d9bf50 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:45.474109 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-91b78b45-47da-42f0-94e6-4c3b33d9bf50 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:45.476259 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-91b78b45-47da-42f0-94e6-4c3b33d9bf50 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:45.580868 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e50b081c-71e1-48fb-97ba-6408f3f6cad6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:45.594808 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e50b081c-71e1-48fb-97ba-6408f3f6cad6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1238 microversion: 2.1 time: 0.259902 Jun 29 12:33:45.595623 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 29/42] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:45 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1238 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:33:45.717103 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0f4b4975-7a70-44cf-8950-796294943b2a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:45.718019 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0f4b4975-7a70-44cf-8950-796294943b2a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:45.727134 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=4 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:33:45.730809 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0f4b4975-7a70-44cf-8950-796294943b2a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:45.732312 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0f4b4975-7a70-44cf-8950-796294943b2a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:45.736007 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0f4b4975-7a70-44cf-8950-796294943b2a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:45.738699 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0f4b4975-7a70-44cf-8950-796294943b2a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:45.862611 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0f4b4975-7a70-44cf-8950-796294943b2a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:45.874786 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0f4b4975-7a70-44cf-8950-796294943b2a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1279 microversion: 2.1 time: 0.162071 Jun 29 12:33:45.889982 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 30/43] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:45 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1279 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:33:45.916879 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-82a2884e-96a4-45a7-b02d-6cfa65075de1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:45.918153 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-82a2884e-96a4-45a7-b02d-6cfa65075de1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:45.932445 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-82a2884e-96a4-45a7-b02d-6cfa65075de1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:45.933279 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-82a2884e-96a4-45a7-b02d-6cfa65075de1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:45.934294 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-82a2884e-96a4-45a7-b02d-6cfa65075de1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:45.934981 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-82a2884e-96a4-45a7-b02d-6cfa65075de1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:46.292836 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-82a2884e-96a4-45a7-b02d-6cfa65075de1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:46.302263 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-82a2884e-96a4-45a7-b02d-6cfa65075de1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:46.307409 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-82a2884e-96a4-45a7-b02d-6cfa65075de1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:46.312998 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-82a2884e-96a4-45a7-b02d-6cfa65075de1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1338 microversion: 2.20 time: 0.400344 Jun 29 12:33:46.324937 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 31/44] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:33:45 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1338 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:33:46.613280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-514e7611-d56a-4e81-8ade-aa4f046e488d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:46.614054 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-514e7611-d56a-4e81-8ade-aa4f046e488d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:46.620240 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-514e7611-d56a-4e81-8ade-aa4f046e488d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:46.620694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-514e7611-d56a-4e81-8ade-aa4f046e488d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:46.621466 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-514e7611-d56a-4e81-8ade-aa4f046e488d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:46.621908 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-514e7611-d56a-4e81-8ade-aa4f046e488d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:46.747876 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-514e7611-d56a-4e81-8ade-aa4f046e488d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:46.756048 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=100 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:33:46.769444 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-514e7611-d56a-4e81-8ade-aa4f046e488d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1242 microversion: 2.1 time: 0.159885 Jun 29 12:33:46.771034 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 32/45] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:46 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1242 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:33:46.896324 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-18e39c97-5904-4e9d-a7bb-23cbbcc236df tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:46.897082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-18e39c97-5904-4e9d-a7bb-23cbbcc236df tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:46.909412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-18e39c97-5904-4e9d-a7bb-23cbbcc236df tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:46.909768 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-18e39c97-5904-4e9d-a7bb-23cbbcc236df tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:46.910853 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-18e39c97-5904-4e9d-a7bb-23cbbcc236df tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:46.911347 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-18e39c97-5904-4e9d-a7bb-23cbbcc236df tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:46.933963 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-91b78b45-47da-42f0-94e6-4c3b33d9bf50 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:46.946852 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-91b78b45-47da-42f0-94e6-4c3b33d9bf50 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1314 microversion: 2.1 time: 1.508968 Jun 29 12:33:46.949406 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 14/46] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:45 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1314 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:47.077073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-18e39c97-5904-4e9d-a7bb-23cbbcc236df tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:47.085560 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-18e39c97-5904-4e9d-a7bb-23cbbcc236df tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1321 microversion: 2.1 time: 0.194752 Jun 29 12:33:47.087782 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 33/47] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:46 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:33:47.332042 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c018bd17-72b3-4aa6-957a-55ada5338dc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:47.333352 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c018bd17-72b3-4aa6-957a-55ada5338dc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:47.341393 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c018bd17-72b3-4aa6-957a-55ada5338dc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:47.342672 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c018bd17-72b3-4aa6-957a-55ada5338dc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:47.343975 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c018bd17-72b3-4aa6-957a-55ada5338dc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:47.344689 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c018bd17-72b3-4aa6-957a-55ada5338dc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:47.790916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4e105c64-11f3-4938-86fc-b3fcbdfe8f1d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:47.792646 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4e105c64-11f3-4938-86fc-b3fcbdfe8f1d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:47.800020 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4e105c64-11f3-4938-86fc-b3fcbdfe8f1d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:47.800549 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4e105c64-11f3-4938-86fc-b3fcbdfe8f1d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:47.801756 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4e105c64-11f3-4938-86fc-b3fcbdfe8f1d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:47.802196 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4e105c64-11f3-4938-86fc-b3fcbdfe8f1d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:47.970746 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4e105c64-11f3-4938-86fc-b3fcbdfe8f1d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:47.985681 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4e105c64-11f3-4938-86fc-b3fcbdfe8f1d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1242 microversion: 2.1 time: 0.200966 Jun 29 12:33:47.986737 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 34/48] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:47 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1242 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:47.991767 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-198eec54-8c00-4bbc-9b6c-1c0aa6a49b91 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:47.993925 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-198eec54-8c00-4bbc-9b6c-1c0aa6a49b91 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:48.027713 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-198eec54-8c00-4bbc-9b6c-1c0aa6a49b91 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:48.028435 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-198eec54-8c00-4bbc-9b6c-1c0aa6a49b91 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:48.029773 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-198eec54-8c00-4bbc-9b6c-1c0aa6a49b91 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:48.030358 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-198eec54-8c00-4bbc-9b6c-1c0aa6a49b91 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:48.041358 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c018bd17-72b3-4aa6-957a-55ada5338dc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:48.051694 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c018bd17-72b3-4aa6-957a-55ada5338dc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:48.053241 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c018bd17-72b3-4aa6-957a-55ada5338dc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:48.064024 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c018bd17-72b3-4aa6-957a-55ada5338dc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.734329 Jun 29 12:33:48.080978 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 15/49] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:33:47 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:33:48.109392 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-18c0dbdd-95e7-4534-9fcd-66b825d54d88 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:48.110328 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-18c0dbdd-95e7-4534-9fcd-66b825d54d88 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:48.123178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-18c0dbdd-95e7-4534-9fcd-66b825d54d88 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:48.125036 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-18c0dbdd-95e7-4534-9fcd-66b825d54d88 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:48.125851 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-18c0dbdd-95e7-4534-9fcd-66b825d54d88 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:48.127688 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-18c0dbdd-95e7-4534-9fcd-66b825d54d88 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:48.307365 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-198eec54-8c00-4bbc-9b6c-1c0aa6a49b91 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:48.317974 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-198eec54-8c00-4bbc-9b6c-1c0aa6a49b91 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1314 microversion: 2.1 time: 0.329380 Jun 29 12:33:48.324408 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 35/50] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:47 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:48.561866 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-18c0dbdd-95e7-4534-9fcd-66b825d54d88 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:48.571869 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-18c0dbdd-95e7-4534-9fcd-66b825d54d88 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1321 microversion: 2.1 time: 0.471613 Jun 29 12:33:48.575716 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 16/51] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:48 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1321 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:49.007291 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-7159d8fa-b422-45cf-b55e-6ab6cd58413b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:49.008085 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-7159d8fa-b422-45cf-b55e-6ab6cd58413b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:49.017177 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7159d8fa-b422-45cf-b55e-6ab6cd58413b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:49.024427 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7159d8fa-b422-45cf-b55e-6ab6cd58413b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:49.025449 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7159d8fa-b422-45cf-b55e-6ab6cd58413b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:49.025970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7159d8fa-b422-45cf-b55e-6ab6cd58413b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:49.100841 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0518f1a3-c60b-4d48-9219-2f1ba49c0fb2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:49.102596 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0518f1a3-c60b-4d48-9219-2f1ba49c0fb2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:49.116738 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0518f1a3-c60b-4d48-9219-2f1ba49c0fb2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:49.117544 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0518f1a3-c60b-4d48-9219-2f1ba49c0fb2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:49.119988 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0518f1a3-c60b-4d48-9219-2f1ba49c0fb2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:49.121729 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0518f1a3-c60b-4d48-9219-2f1ba49c0fb2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:49.170405 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7159d8fa-b422-45cf-b55e-6ab6cd58413b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:49.187959 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-7159d8fa-b422-45cf-b55e-6ab6cd58413b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1242 microversion: 2.1 time: 0.186768 Jun 29 12:33:49.190858 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 36/52] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:48 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1242 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:49.338833 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0f7078cd-5b12-4979-9fde-2cf757cf8549 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:49.339728 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0f7078cd-5b12-4979-9fde-2cf757cf8549 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:49.352997 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0f7078cd-5b12-4979-9fde-2cf757cf8549 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:49.355349 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0f7078cd-5b12-4979-9fde-2cf757cf8549 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:49.358712 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0f7078cd-5b12-4979-9fde-2cf757cf8549 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:49.359287 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0f7078cd-5b12-4979-9fde-2cf757cf8549 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:49.668344 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0f7078cd-5b12-4979-9fde-2cf757cf8549 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:49.684881 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0f7078cd-5b12-4979-9fde-2cf757cf8549 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1314 microversion: 2.1 time: 0.353101 Jun 29 12:33:49.685463 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 37/53] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:49 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:49.698347 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-43baa3d7-e9b6-4571-9a5a-37c3cb78d507 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:49.701587 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-43baa3d7-e9b6-4571-9a5a-37c3cb78d507 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:49.714030 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-43baa3d7-e9b6-4571-9a5a-37c3cb78d507 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:49.714461 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-43baa3d7-e9b6-4571-9a5a-37c3cb78d507 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:49.715350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-43baa3d7-e9b6-4571-9a5a-37c3cb78d507 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:49.715785 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-43baa3d7-e9b6-4571-9a5a-37c3cb78d507 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:49.758622 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0518f1a3-c60b-4d48-9219-2f1ba49c0fb2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:49.771222 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0518f1a3-c60b-4d48-9219-2f1ba49c0fb2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:49.773287 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0518f1a3-c60b-4d48-9219-2f1ba49c0fb2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:49.775301 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0518f1a3-c60b-4d48-9219-2f1ba49c0fb2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.680887 Jun 29 12:33:49.787693 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 17/54] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:33:49 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:33:49.973477 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-43baa3d7-e9b6-4571-9a5a-37c3cb78d507 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:49.983169 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-43baa3d7-e9b6-4571-9a5a-37c3cb78d507 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1321 microversion: 2.1 time: 0.294596 Jun 29 12:33:49.983984 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 38/55] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:49 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1321 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:50.129587 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-370f87cf-184e-4ae3-b33f-4ad33f571c16 req-adb025a5-f9cb-4981-aab6-2b98963f36ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d6ff7e6-212e-41a7-9c74-df2c4e3a2010", "tag": "9c0824d3-f095-48c6-8750-a139a1ca3582"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:33:50.175306 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-370f87cf-184e-4ae3-b33f-4ad33f571c16 req-adb025a5-f9cb-4981-aab6-2b98963f36ca service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:50.175997 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-370f87cf-184e-4ae3-b33f-4ad33f571c16 req-adb025a5-f9cb-4981-aab6-2b98963f36ca service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:50.207691 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3bcab617-6e51-4467-b5e3-45a0dfb261df tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:50.208272 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3bcab617-6e51-4467-b5e3-45a0dfb261df tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:50.213260 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:33:50.219990 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3bcab617-6e51-4467-b5e3-45a0dfb261df tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:50.226469 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3bcab617-6e51-4467-b5e3-45a0dfb261df tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:50.227488 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3bcab617-6e51-4467-b5e3-45a0dfb261df tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:50.228075 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3bcab617-6e51-4467-b5e3-45a0dfb261df tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:50.234493 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-370f87cf-184e-4ae3-b33f-4ad33f571c16 req-adb025a5-f9cb-4981-aab6-2b98963f36ca service nova] Creating event network-changed:9c0824d3-f095-48c6-8750-a139a1ca3582 for instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 on hv-cinder-81268 Jun 29 12:33:50.240958 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-370f87cf-184e-4ae3-b33f-4ad33f571c16 req-adb025a5-f9cb-4981-aab6-2b98963f36ca service nova] Acquired lock "compute-rpcapi-router" {{(pid=124316) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 29 12:33:50.243059 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b770c9e2-89b9-463c-8dca-5fd33c5328dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:50.246736 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b770c9e2-89b9-463c-8dca-5fd33c5328dc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:50.247770 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b770c9e2-89b9-463c-8dca-5fd33c5328dc None None] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:50.248486 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b770c9e2-89b9-463c-8dca-5fd33c5328dc None None] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:50.269383 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.compute.rpcapi [None req-b770c9e2-89b9-463c-8dca-5fd33c5328dc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 29 12:33:50.273071 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b770c9e2-89b9-463c-8dca-5fd33c5328dc None None] Releasing lock "compute-rpcapi-router" {{(pid=124316) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 29 12:33:50.310946 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b770c9e2-89b9-463c-8dca-5fd33c5328dc None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.521585 Jun 29 12:33:50.311801 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 18/56] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:33:50.368707 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3bcab617-6e51-4467-b5e3-45a0dfb261df tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:50.379621 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3bcab617-6e51-4467-b5e3-45a0dfb261df tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1242 microversion: 2.1 time: 0.177669 Jun 29 12:33:50.380625 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 39/57] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:50 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1242 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:33:50.711921 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-bbc68fdf-564f-46a4-b239-8fec5a5d9fd1 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:50.713005 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-bbc68fdf-564f-46a4-b239-8fec5a5d9fd1 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:50.730638 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bbc68fdf-564f-46a4-b239-8fec5a5d9fd1 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:50.731904 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bbc68fdf-564f-46a4-b239-8fec5a5d9fd1 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:50.732697 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bbc68fdf-564f-46a4-b239-8fec5a5d9fd1 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:50.733204 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bbc68fdf-564f-46a4-b239-8fec5a5d9fd1 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:50.799006 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-580f3180-275e-45af-b3be-00c6f4596923 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:50.799006 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-580f3180-275e-45af-b3be-00c6f4596923 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:50.807769 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-580f3180-275e-45af-b3be-00c6f4596923 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:50.809605 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-580f3180-275e-45af-b3be-00c6f4596923 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:50.812886 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-580f3180-275e-45af-b3be-00c6f4596923 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:50.813347 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-580f3180-275e-45af-b3be-00c6f4596923 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:51.016954 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-bbc68fdf-564f-46a4-b239-8fec5a5d9fd1 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:51.035346 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-bbc68fdf-564f-46a4-b239-8fec5a5d9fd1 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1314 microversion: 2.1 time: 0.335238 Jun 29 12:33:51.040326 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 19/58] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:50 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:51.054131 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8a6450d7-1bf6-4f37-8029-d8b2b0b66181 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:51.058379 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8a6450d7-1bf6-4f37-8029-d8b2b0b66181 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:51.083617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8a6450d7-1bf6-4f37-8029-d8b2b0b66181 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:51.084425 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8a6450d7-1bf6-4f37-8029-d8b2b0b66181 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:51.085479 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8a6450d7-1bf6-4f37-8029-d8b2b0b66181 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:51.087338 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8a6450d7-1bf6-4f37-8029-d8b2b0b66181 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:51.194838 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-580f3180-275e-45af-b3be-00c6f4596923 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:51.209365 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-580f3180-275e-45af-b3be-00c6f4596923 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:51.212363 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-580f3180-275e-45af-b3be-00c6f4596923 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:51.213982 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-580f3180-275e-45af-b3be-00c6f4596923 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.421080 Jun 29 12:33:51.215021 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 40/59] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:33:50 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:33:51.381411 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8a6450d7-1bf6-4f37-8029-d8b2b0b66181 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:51.391963 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8a6450d7-1bf6-4f37-8029-d8b2b0b66181 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1321 microversion: 2.1 time: 0.348961 Jun 29 12:33:51.398498 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ecbe26ad-f6f6-4cc8-9251-b0cb525c820a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:51.399326 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ecbe26ad-f6f6-4cc8-9251-b0cb525c820a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:51.401729 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 20/60] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:51 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1321 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:51.412313 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ecbe26ad-f6f6-4cc8-9251-b0cb525c820a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:51.413085 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ecbe26ad-f6f6-4cc8-9251-b0cb525c820a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:51.418754 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ecbe26ad-f6f6-4cc8-9251-b0cb525c820a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:51.424690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ecbe26ad-f6f6-4cc8-9251-b0cb525c820a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:51.570968 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ecbe26ad-f6f6-4cc8-9251-b0cb525c820a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:51.580482 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ecbe26ad-f6f6-4cc8-9251-b0cb525c820a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1242 microversion: 2.1 time: 0.186834 Jun 29 12:33:51.581070 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 41/61] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:51 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1242 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:33:52.057251 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f9074615-0b93-47cc-998c-3c9e96df98fa tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:52.057942 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f9074615-0b93-47cc-998c-3c9e96df98fa tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:52.067335 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f9074615-0b93-47cc-998c-3c9e96df98fa tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:52.069521 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f9074615-0b93-47cc-998c-3c9e96df98fa tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:52.071541 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f9074615-0b93-47cc-998c-3c9e96df98fa tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:52.072719 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f9074615-0b93-47cc-998c-3c9e96df98fa tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:52.232685 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-cd4a969f-6f48-492c-878d-fdafc82a0f5c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:52.233934 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-cd4a969f-6f48-492c-878d-fdafc82a0f5c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:52.248969 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cd4a969f-6f48-492c-878d-fdafc82a0f5c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:52.249657 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cd4a969f-6f48-492c-878d-fdafc82a0f5c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:52.251270 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cd4a969f-6f48-492c-878d-fdafc82a0f5c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:52.253432 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cd4a969f-6f48-492c-878d-fdafc82a0f5c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:52.377173 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f9074615-0b93-47cc-998c-3c9e96df98fa tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:52.390015 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f9074615-0b93-47cc-998c-3c9e96df98fa tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1314 microversion: 2.1 time: 0.336542 Jun 29 12:33:52.391255 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 21/62] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:52 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:52.412361 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-c02ec8f7-4a33-4dcd-92c7-2cd60899eafa req-adf15e4d-5ac8-4bad-8c03-6c2b1c14d76a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2fe6e32-c192-444c-8fa1-df3767145bc0", "tag": "1e5740b0-fd73-4bb9-8d83-8f4bdfb7b8ed"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:33:52.432892 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-c02ec8f7-4a33-4dcd-92c7-2cd60899eafa req-adf15e4d-5ac8-4bad-8c03-6c2b1c14d76a service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:52.433376 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-c02ec8f7-4a33-4dcd-92c7-2cd60899eafa req-adf15e4d-5ac8-4bad-8c03-6c2b1c14d76a service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:52.460092 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-c02ec8f7-4a33-4dcd-92c7-2cd60899eafa req-adf15e4d-5ac8-4bad-8c03-6c2b1c14d76a service nova] Creating event network-changed:1e5740b0-fd73-4bb9-8d83-8f4bdfb7b8ed for instance f2fe6e32-c192-444c-8fa1-df3767145bc0 on hv-cinder-81268 Jun 29 12:33:52.475039 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-c02ec8f7-4a33-4dcd-92c7-2cd60899eafa req-adf15e4d-5ac8-4bad-8c03-6c2b1c14d76a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083000 Jun 29 12:33:52.475748 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 22/63] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:33:52.493256 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1826adad-b464-4a46-b99c-f8bf1e6165b4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:52.494372 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-1826adad-b464-4a46-b99c-f8bf1e6165b4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:52.511613 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1826adad-b464-4a46-b99c-f8bf1e6165b4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:52.512118 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1826adad-b464-4a46-b99c-f8bf1e6165b4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:52.515709 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1826adad-b464-4a46-b99c-f8bf1e6165b4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:52.516187 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1826adad-b464-4a46-b99c-f8bf1e6165b4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:52.562381 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-cd4a969f-6f48-492c-878d-fdafc82a0f5c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:52.574680 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-cd4a969f-6f48-492c-878d-fdafc82a0f5c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:52.576761 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-cd4a969f-6f48-492c-878d-fdafc82a0f5c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:52.578377 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-cd4a969f-6f48-492c-878d-fdafc82a0f5c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.349604 Jun 29 12:33:52.590068 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 42/64] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:33:52 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:33:52.621501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-06a9e4c7-296b-4cb7-be83-ab4f22f0e245 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:52.623445 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-06a9e4c7-296b-4cb7-be83-ab4f22f0e245 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:52.643061 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-06a9e4c7-296b-4cb7-be83-ab4f22f0e245 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:52.645506 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-06a9e4c7-296b-4cb7-be83-ab4f22f0e245 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:52.648006 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-06a9e4c7-296b-4cb7-be83-ab4f22f0e245 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:52.648866 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-06a9e4c7-296b-4cb7-be83-ab4f22f0e245 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:52.744320 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-06a9e4c7-296b-4cb7-be83-ab4f22f0e245 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:52.756764 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-06a9e4c7-296b-4cb7-be83-ab4f22f0e245 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1242 microversion: 2.1 time: 0.146508 Jun 29 12:33:52.766989 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 43/65] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:52 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1242 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:52.822167 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-1826adad-b464-4a46-b99c-f8bf1e6165b4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:52.830631 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-1826adad-b464-4a46-b99c-f8bf1e6165b4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1321 microversion: 2.1 time: 0.353046 Jun 29 12:33:52.833325 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 23/66] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:52 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1321 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:53.414402 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1d0f3cf2-d243-4501-89be-8f68439ef51e tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:53.415059 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1d0f3cf2-d243-4501-89be-8f68439ef51e tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:53.422251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1d0f3cf2-d243-4501-89be-8f68439ef51e tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:53.422790 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1d0f3cf2-d243-4501-89be-8f68439ef51e tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:53.423908 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1d0f3cf2-d243-4501-89be-8f68439ef51e tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:53.424312 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1d0f3cf2-d243-4501-89be-8f68439ef51e tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:53.593647 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1d0f3cf2-d243-4501-89be-8f68439ef51e tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:53.598376 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-7c6ca39b-988b-461a-95ce-f53c7d725d3e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:53.599603 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-7c6ca39b-988b-461a-95ce-f53c7d725d3e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:53.602067 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1d0f3cf2-d243-4501-89be-8f68439ef51e tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1314 microversion: 2.1 time: 0.198321 Jun 29 12:33:53.603043 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:33:53.610973 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 44/67] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:53 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:53.618178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7c6ca39b-988b-461a-95ce-f53c7d725d3e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:53.618664 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7c6ca39b-988b-461a-95ce-f53c7d725d3e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:53.619525 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7c6ca39b-988b-461a-95ce-f53c7d725d3e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:53.619996 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7c6ca39b-988b-461a-95ce-f53c7d725d3e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:53.776347 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-edace875-a629-4ef0-8bb8-3208b9c27389 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:53.777382 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-edace875-a629-4ef0-8bb8-3208b9c27389 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:53.790980 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-edace875-a629-4ef0-8bb8-3208b9c27389 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:53.790980 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-edace875-a629-4ef0-8bb8-3208b9c27389 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:53.794702 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-edace875-a629-4ef0-8bb8-3208b9c27389 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:53.795164 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-edace875-a629-4ef0-8bb8-3208b9c27389 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:53.879751 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7c6ca39b-988b-461a-95ce-f53c7d725d3e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:53.888593 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7c6ca39b-988b-461a-95ce-f53c7d725d3e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:53.890104 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7c6ca39b-988b-461a-95ce-f53c7d725d3e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:53.891349 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-7c6ca39b-988b-461a-95ce-f53c7d725d3e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.298148 Jun 29 12:33:53.904858 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 24/68] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:33:53 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:33:53.907223 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-edace875-a629-4ef0-8bb8-3208b9c27389 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:53.911001 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b33ac3d5-68fb-4f94-bf57-58be9cd02762 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:53.912034 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b33ac3d5-68fb-4f94-bf57-58be9cd02762 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:53.919398 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b33ac3d5-68fb-4f94-bf57-58be9cd02762 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:53.921718 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b33ac3d5-68fb-4f94-bf57-58be9cd02762 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:53.923023 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b33ac3d5-68fb-4f94-bf57-58be9cd02762 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:53.923897 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b33ac3d5-68fb-4f94-bf57-58be9cd02762 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:53.925201 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-edace875-a629-4ef0-8bb8-3208b9c27389 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1242 microversion: 2.1 time: 0.153154 Jun 29 12:33:53.926590 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 45/69] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:53 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1242 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:54.136203 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b33ac3d5-68fb-4f94-bf57-58be9cd02762 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:54.145849 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b33ac3d5-68fb-4f94-bf57-58be9cd02762 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1321 microversion: 2.1 time: 0.239446 Jun 29 12:33:54.146470 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 25/70] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:53 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:54.620881 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-aea00d40-65f4-43d5-8803-075294481458 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:54.622382 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-aea00d40-65f4-43d5-8803-075294481458 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:54.634991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aea00d40-65f4-43d5-8803-075294481458 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:54.635829 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aea00d40-65f4-43d5-8803-075294481458 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:54.637405 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aea00d40-65f4-43d5-8803-075294481458 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:54.638041 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aea00d40-65f4-43d5-8803-075294481458 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:54.911746 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-902d82e0-2dce-45a0-abdf-6ad414e03ce2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:54.912482 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-902d82e0-2dce-45a0-abdf-6ad414e03ce2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:54.923710 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-902d82e0-2dce-45a0-abdf-6ad414e03ce2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:54.929065 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-902d82e0-2dce-45a0-abdf-6ad414e03ce2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:54.930254 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-902d82e0-2dce-45a0-abdf-6ad414e03ce2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:54.933251 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-902d82e0-2dce-45a0-abdf-6ad414e03ce2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:55.017683 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-aea00d40-65f4-43d5-8803-075294481458 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:55.032165 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-aea00d40-65f4-43d5-8803-075294481458 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1314 microversion: 2.1 time: 0.409930 Jun 29 12:33:55.032747 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 46/71] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:54 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:55.046491 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e83e78ca-a76a-4b0d-8788-3a9123a3db56 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:55.054452 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e83e78ca-a76a-4b0d-8788-3a9123a3db56 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:55.073265 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e83e78ca-a76a-4b0d-8788-3a9123a3db56 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:55.073598 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e83e78ca-a76a-4b0d-8788-3a9123a3db56 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:55.075146 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e83e78ca-a76a-4b0d-8788-3a9123a3db56 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:55.075772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e83e78ca-a76a-4b0d-8788-3a9123a3db56 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:55.145863 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=28 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:33:55.248050 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e83e78ca-a76a-4b0d-8788-3a9123a3db56 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:55.259365 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e83e78ca-a76a-4b0d-8788-3a9123a3db56 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1242 microversion: 2.1 time: 0.219149 Jun 29 12:33:55.260459 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 47/72] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:55 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1242 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:55.274225 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a67c5fb9-6e6c-4b43-9176-a7a261e0d490 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:55.275617 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a67c5fb9-6e6c-4b43-9176-a7a261e0d490 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:55.289838 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a67c5fb9-6e6c-4b43-9176-a7a261e0d490 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:55.290275 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a67c5fb9-6e6c-4b43-9176-a7a261e0d490 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:55.291123 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a67c5fb9-6e6c-4b43-9176-a7a261e0d490 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:55.291555 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a67c5fb9-6e6c-4b43-9176-a7a261e0d490 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:55.350842 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-902d82e0-2dce-45a0-abdf-6ad414e03ce2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:55.368554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-902d82e0-2dce-45a0-abdf-6ad414e03ce2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:55.370303 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-902d82e0-2dce-45a0-abdf-6ad414e03ce2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:55.371498 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-902d82e0-2dce-45a0-abdf-6ad414e03ce2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.464708 Jun 29 12:33:55.381388 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 26/73] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:33:54 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:33:55.474221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a67c5fb9-6e6c-4b43-9176-a7a261e0d490 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:55.481773 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a67c5fb9-6e6c-4b43-9176-a7a261e0d490 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1321 microversion: 2.1 time: 0.219965 Jun 29 12:33:55.490770 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 48/74] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:55 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:56.054299 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-adcdce09-86b6-4935-bd8e-7c77ceda9b49 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:56.057273 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-adcdce09-86b6-4935-bd8e-7c77ceda9b49 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:56.067616 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-adcdce09-86b6-4935-bd8e-7c77ceda9b49 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:56.068945 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-adcdce09-86b6-4935-bd8e-7c77ceda9b49 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:56.070257 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-adcdce09-86b6-4935-bd8e-7c77ceda9b49 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:56.071099 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-adcdce09-86b6-4935-bd8e-7c77ceda9b49 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:56.282768 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ff039bad-3206-48d0-b249-76752b5b8d4f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:56.283714 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ff039bad-3206-48d0-b249-76752b5b8d4f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:56.290945 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=20 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:33:56.313844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ff039bad-3206-48d0-b249-76752b5b8d4f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:56.318078 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ff039bad-3206-48d0-b249-76752b5b8d4f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:56.320320 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ff039bad-3206-48d0-b249-76752b5b8d4f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:56.322167 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ff039bad-3206-48d0-b249-76752b5b8d4f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:56.419232 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=100 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:33:56.686285 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-adcdce09-86b6-4935-bd8e-7c77ceda9b49 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:56.693806 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-adcdce09-86b6-4935-bd8e-7c77ceda9b49 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1314 microversion: 2.1 time: 0.647407 Jun 29 12:33:56.705918 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 27/75] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:56 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1314 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:56.711385 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4da2f1e0-99df-416e-b939-ea0e91b33dcb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:56.711987 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4da2f1e0-99df-416e-b939-ea0e91b33dcb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:56.734531 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4da2f1e0-99df-416e-b939-ea0e91b33dcb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:56.734991 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4da2f1e0-99df-416e-b939-ea0e91b33dcb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:56.735775 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4da2f1e0-99df-416e-b939-ea0e91b33dcb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:56.736213 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4da2f1e0-99df-416e-b939-ea0e91b33dcb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:56.783134 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=100 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:33:56.934688 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ff039bad-3206-48d0-b249-76752b5b8d4f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:56.948159 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ff039bad-3206-48d0-b249-76752b5b8d4f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1290 microversion: 2.1 time: 0.669145 Jun 29 12:33:56.948880 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 49/76] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:56 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1290 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:56.957466 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d1596537-7be8-4413-b152-be37e47a16e7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:56.958224 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d1596537-7be8-4413-b152-be37e47a16e7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:56.983550 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d1596537-7be8-4413-b152-be37e47a16e7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:56.986205 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d1596537-7be8-4413-b152-be37e47a16e7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:56.987379 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d1596537-7be8-4413-b152-be37e47a16e7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:56.989011 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d1596537-7be8-4413-b152-be37e47a16e7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:57.727022 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4da2f1e0-99df-416e-b939-ea0e91b33dcb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:57.748579 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4da2f1e0-99df-416e-b939-ea0e91b33dcb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:57.752125 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4da2f1e0-99df-416e-b939-ea0e91b33dcb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:57.774344 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4da2f1e0-99df-416e-b939-ea0e91b33dcb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 1.064102 Jun 29 12:33:57.775460 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 28/77] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:33:56 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:33:57.806164 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d536873e-0d7c-484c-a37d-417f15046429 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:57.807467 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d536873e-0d7c-484c-a37d-417f15046429 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:57.835005 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d536873e-0d7c-484c-a37d-417f15046429 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:57.837974 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d536873e-0d7c-484c-a37d-417f15046429 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:57.841097 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d536873e-0d7c-484c-a37d-417f15046429 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:57.843687 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d536873e-0d7c-484c-a37d-417f15046429 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:57.914042 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d1596537-7be8-4413-b152-be37e47a16e7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:57.936066 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d1596537-7be8-4413-b152-be37e47a16e7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1321 microversion: 2.1 time: 0.984466 Jun 29 12:33:57.939217 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 50/78] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:56 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1321 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:57.967956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ff83b66e-84a8-4534-a61c-25fed75116aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:57.968974 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ff83b66e-84a8-4534-a61c-25fed75116aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:57.981198 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ff83b66e-84a8-4534-a61c-25fed75116aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:57.982362 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ff83b66e-84a8-4534-a61c-25fed75116aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:57.985062 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ff83b66e-84a8-4534-a61c-25fed75116aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:57.986406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ff83b66e-84a8-4534-a61c-25fed75116aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:58.197682 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ff83b66e-84a8-4534-a61c-25fed75116aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:58.210730 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ff83b66e-84a8-4534-a61c-25fed75116aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1296 microversion: 2.1 time: 0.248007 Jun 29 12:33:58.215143 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 51/79] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:57 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1296 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:58.611222 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-91c8d1f0-c119-4bdf-a196-136f46de679c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1278670149", "imageRef": "70887696-f652-46b0-a5be-bfb400986078", "flavorRef": "452", "networks": [{"uuid": "953cb3ea-ea04-4857-b87d-b4cc7d724de7"}]}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:33:58.710411 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.network.neutron [None req-91c8d1f0-c119-4bdf-a196-136f46de679c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] validate_networks() for [('953cb3ea-ea04-4857-b87d-b4cc7d724de7', None, None, None, None, None)] {{(pid=124317) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 12:33:58.797327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d536873e-0d7c-484c-a37d-417f15046429 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:58.806967 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d536873e-0d7c-484c-a37d-417f15046429 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1314 microversion: 2.1 time: 1.029107 Jun 29 12:33:58.820701 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 29/80] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:57 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1314 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:58.943268 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-57b63c04-40d3-418c-9ae1-a7ea6efd7eb8 req-b55a0c82-ad5f-4ad1-97be-fca14d265b02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d59927-1de5-433d-8c94-5bf3aab49f49", "tag": "ab0649e0-5f8b-479c-990a-de8e68bba496"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:33:58.966001 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-57b63c04-40d3-418c-9ae1-a7ea6efd7eb8 req-b55a0c82-ad5f-4ad1-97be-fca14d265b02 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:58.966915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-57b63c04-40d3-418c-9ae1-a7ea6efd7eb8 req-b55a0c82-ad5f-4ad1-97be-fca14d265b02 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:58.989530 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-57b63c04-40d3-418c-9ae1-a7ea6efd7eb8 req-b55a0c82-ad5f-4ad1-97be-fca14d265b02 service nova] Creating event network-changed:ab0649e0-5f8b-479c-990a-de8e68bba496 for instance d6d59927-1de5-433d-8c94-5bf3aab49f49 on hv-cinder-81268 Jun 29 12:33:58.998128 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-57b63c04-40d3-418c-9ae1-a7ea6efd7eb8 req-b55a0c82-ad5f-4ad1-97be-fca14d265b02 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173807 Jun 29 12:33:58.999385 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 30/81] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:33:59.007264 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ee88e604-dccb-4472-aa3e-36c1c009ad68 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:59.008811 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ee88e604-dccb-4472-aa3e-36c1c009ad68 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:59.019976 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ee88e604-dccb-4472-aa3e-36c1c009ad68 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:59.021485 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ee88e604-dccb-4472-aa3e-36c1c009ad68 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:59.022619 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ee88e604-dccb-4472-aa3e-36c1c009ad68 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:59.023204 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ee88e604-dccb-4472-aa3e-36c1c009ad68 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:59.417732 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ee88e604-dccb-4472-aa3e-36c1c009ad68 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:59.429561 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ee88e604-dccb-4472-aa3e-36c1c009ad68 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:59.431750 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ee88e604-dccb-4472-aa3e-36c1c009ad68 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:59.433384 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ee88e604-dccb-4472-aa3e-36c1c009ad68 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.432422 Jun 29 12:33:59.434686 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 31/82] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:33:58 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:33:59.441885 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c15819ab-5ecf-48e7-8731-b892a0ad96e9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:59.442948 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c15819ab-5ecf-48e7-8731-b892a0ad96e9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:59.450930 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c15819ab-5ecf-48e7-8731-b892a0ad96e9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:59.451528 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c15819ab-5ecf-48e7-8731-b892a0ad96e9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:59.452398 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c15819ab-5ecf-48e7-8731-b892a0ad96e9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:59.453669 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c15819ab-5ecf-48e7-8731-b892a0ad96e9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:59.655531 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c15819ab-5ecf-48e7-8731-b892a0ad96e9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:59.665349 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c15819ab-5ecf-48e7-8731-b892a0ad96e9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1321 microversion: 2.1 time: 0.229090 Jun 29 12:33:59.666503 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 32/83] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:59 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:33:59.683981 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2f32f987-7c08-472e-adcc-3531de2fa6bd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:59.685859 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2f32f987-7c08-472e-adcc-3531de2fa6bd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:59.696024 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2f32f987-7c08-472e-adcc-3531de2fa6bd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:59.696768 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2f32f987-7c08-472e-adcc-3531de2fa6bd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:59.699739 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2f32f987-7c08-472e-adcc-3531de2fa6bd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:59.700279 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2f32f987-7c08-472e-adcc-3531de2fa6bd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:59.712049 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-91c8d1f0-c119-4bdf-a196-136f46de679c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Flavor limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 12:33:59.712613 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-91c8d1f0-c119-4bdf-a196-136f46de679c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Image limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 12:33:59.713284 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-91c8d1f0-c119-4bdf-a196-136f46de679c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Flavor pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 12:33:59.713764 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-91c8d1f0-c119-4bdf-a196-136f46de679c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Image pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 12:33:59.714248 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-91c8d1f0-c119-4bdf-a196-136f46de679c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 12:33:59.724210 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-91c8d1f0-c119-4bdf-a196-136f46de679c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:59.724746 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-91c8d1f0-c119-4bdf-a196-136f46de679c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:59.725611 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-91c8d1f0-c119-4bdf-a196-136f46de679c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:59.726111 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-91c8d1f0-c119-4bdf-a196-136f46de679c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:59.753022 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-91c8d1f0-c119-4bdf-a196-136f46de679c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Getting quotas for project ed93385ff03f4672acc79e103ffcb82e. Resources: {'cores', 'ram', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:33:59.758103 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-91c8d1f0-c119-4bdf-a196-136f46de679c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Getting quotas for user bba6a17fc19645c29fce6fa655095a0a and project ed93385ff03f4672acc79e103ffcb82e. Resources: {'cores', 'ram', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:33:59.769566 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-91c8d1f0-c119-4bdf-a196-136f46de679c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Going to run 1 instances... {{(pid=124317) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 12:33:59.772469 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-91c8d1f0-c119-4bdf-a196-136f46de679c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70887696-f652-46b0-a5be-bfb400986078',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124317) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 12:33:59.829823 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-91c8d1f0-c119-4bdf-a196-136f46de679c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.226645 Jun 29 12:33:59.831170 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 52/84] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 12:33:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 29 12:33:59.836729 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-10906a7c-bde2-4477-979a-795c34c5d062 req-70f744ce-36a4-48df-983a-3c69be0e1843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d615c3d2-4ba0-41e9-be7e-8e51d8e36b86", "tag": "c73e8ec9-3797-428f-82d9-0808363d1eab"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:33:59.849896 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-10906a7c-bde2-4477-979a-795c34c5d062 req-70f744ce-36a4-48df-983a-3c69be0e1843 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:59.850495 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-10906a7c-bde2-4477-979a-795c34c5d062 req-70f744ce-36a4-48df-983a-3c69be0e1843 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:59.874591 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-10906a7c-bde2-4477-979a-795c34c5d062 req-70f744ce-36a4-48df-983a-3c69be0e1843 service nova] Creating event network-changed:c73e8ec9-3797-428f-82d9-0808363d1eab for instance d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 on hv-cinder-81268 Jun 29 12:33:59.875539 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-10906a7c-bde2-4477-979a-795c34c5d062 req-70f744ce-36a4-48df-983a-3c69be0e1843 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124317) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 29 12:33:59.876508 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e69058b9-10b1-491c-9fa8-b83f4fdc9f5f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:59.877009 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e69058b9-10b1-491c-9fa8-b83f4fdc9f5f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:59.877848 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e69058b9-10b1-491c-9fa8-b83f4fdc9f5f None None] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:59.878893 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e69058b9-10b1-491c-9fa8-b83f4fdc9f5f None None] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:59.887962 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.compute.rpcapi [None req-e69058b9-10b1-491c-9fa8-b83f4fdc9f5f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 29 12:33:59.889234 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e69058b9-10b1-491c-9fa8-b83f4fdc9f5f None None] Releasing lock "compute-rpcapi-router" {{(pid=124317) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 29 12:33:59.921352 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e69058b9-10b1-491c-9fa8-b83f4fdc9f5f None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088598 Jun 29 12:33:59.922640 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 53/85] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:33:59.927274 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6375c2e7-8c53-4f90-8912-bbd26f9ef548 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:33:59.927973 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-6375c2e7-8c53-4f90-8912-bbd26f9ef548 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:33:59.934490 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6375c2e7-8c53-4f90-8912-bbd26f9ef548 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:59.934955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6375c2e7-8c53-4f90-8912-bbd26f9ef548 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:59.935725 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6375c2e7-8c53-4f90-8912-bbd26f9ef548 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:33:59.936343 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6375c2e7-8c53-4f90-8912-bbd26f9ef548 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:33:59.975627 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2f32f987-7c08-472e-adcc-3531de2fa6bd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:33:59.990322 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2f32f987-7c08-472e-adcc-3531de2fa6bd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1364 microversion: 2.1 time: 0.318640 Jun 29 12:33:59.991113 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 33/86] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:59 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1364 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:00.001308 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e707f189-564d-4d07-90da-871a0771ee19 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:00.004092 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e707f189-564d-4d07-90da-871a0771ee19 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:00.127818 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6375c2e7-8c53-4f90-8912-bbd26f9ef548 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:00.134743 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e707f189-564d-4d07-90da-871a0771ee19 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:00.138158 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6375c2e7-8c53-4f90-8912-bbd26f9ef548 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1314 microversion: 2.1 time: 0.215000 Jun 29 12:34:00.147984 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 54/87] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:59 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:00.151036 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e707f189-564d-4d07-90da-871a0771ee19 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1214 microversion: 2.1 time: 0.158164 Jun 29 12:34:00.153967 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 34/88] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:33:59 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1214 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:00.455738 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4b73982b-e32b-4215-ae7a-26ff97276603 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:00.456809 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4b73982b-e32b-4215-ae7a-26ff97276603 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:00.473746 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4b73982b-e32b-4215-ae7a-26ff97276603 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:00.474596 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4b73982b-e32b-4215-ae7a-26ff97276603 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:00.476369 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4b73982b-e32b-4215-ae7a-26ff97276603 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:00.480067 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4b73982b-e32b-4215-ae7a-26ff97276603 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:00.685082 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-7f5274b9-ff4e-40ce-884b-37bba1993a4b tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:00.686521 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-7f5274b9-ff4e-40ce-884b-37bba1993a4b tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:00.688486 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=8 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:34:00.699905 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7f5274b9-ff4e-40ce-884b-37bba1993a4b tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:00.700625 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7f5274b9-ff4e-40ce-884b-37bba1993a4b tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:00.701416 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7f5274b9-ff4e-40ce-884b-37bba1993a4b tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:00.701858 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7f5274b9-ff4e-40ce-884b-37bba1993a4b tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:00.845119 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4b73982b-e32b-4215-ae7a-26ff97276603 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:00.862464 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4b73982b-e32b-4215-ae7a-26ff97276603 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:00.870045 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4b73982b-e32b-4215-ae7a-26ff97276603 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:00.872114 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4b73982b-e32b-4215-ae7a-26ff97276603 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.422689 Jun 29 12:34:00.875010 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 55/89] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:34:00 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:34:01.008257 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1e58956c-f736-4432-9d93-fd8ac1d2643d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:01.009086 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1e58956c-f736-4432-9d93-fd8ac1d2643d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:01.015432 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1e58956c-f736-4432-9d93-fd8ac1d2643d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:01.016274 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1e58956c-f736-4432-9d93-fd8ac1d2643d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:01.017116 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1e58956c-f736-4432-9d93-fd8ac1d2643d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:01.017758 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1e58956c-f736-4432-9d93-fd8ac1d2643d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:01.138942 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7f5274b9-ff4e-40ce-884b-37bba1993a4b tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:01.163399 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-7f5274b9-ff4e-40ce-884b-37bba1993a4b tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1321 microversion: 2.1 time: 0.482795 Jun 29 12:34:01.163999 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 35/90] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:00 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1321 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:01.178995 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b3e31450-3fb5-4f1d-8444-51a00150f510 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:01.179631 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b3e31450-3fb5-4f1d-8444-51a00150f510 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:01.186054 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b3e31450-3fb5-4f1d-8444-51a00150f510 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:01.186536 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b3e31450-3fb5-4f1d-8444-51a00150f510 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:01.187313 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b3e31450-3fb5-4f1d-8444-51a00150f510 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:01.187750 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b3e31450-3fb5-4f1d-8444-51a00150f510 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:01.369483 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b3e31450-3fb5-4f1d-8444-51a00150f510 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:01.380511 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b3e31450-3fb5-4f1d-8444-51a00150f510 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1314 microversion: 2.1 time: 0.206860 Jun 29 12:34:01.380511 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 36/91] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:01 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:01.386138 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f2c3a8b9-a8ce-48c0-a0c1-516d56bfb848 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:01.386746 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f2c3a8b9-a8ce-48c0-a0c1-516d56bfb848 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:01.395175 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f2c3a8b9-a8ce-48c0-a0c1-516d56bfb848 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:01.396499 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f2c3a8b9-a8ce-48c0-a0c1-516d56bfb848 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:01.397832 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f2c3a8b9-a8ce-48c0-a0c1-516d56bfb848 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:01.398578 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f2c3a8b9-a8ce-48c0-a0c1-516d56bfb848 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:01.477281 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f2c3a8b9-a8ce-48c0-a0c1-516d56bfb848 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:01.485832 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f2c3a8b9-a8ce-48c0-a0c1-516d56bfb848 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1218 microversion: 2.1 time: 0.104765 Jun 29 12:34:01.486406 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 37/92] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:01 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:01.616316 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1e58956c-f736-4432-9d93-fd8ac1d2643d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:01.624420 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1e58956c-f736-4432-9d93-fd8ac1d2643d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1364 microversion: 2.1 time: 0.620515 Jun 29 12:34:01.625360 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 56/93] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:01 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1364 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:01.892815 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b9c71012-9d8b-4586-a583-26b9bb990eae tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:01.893427 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b9c71012-9d8b-4586-a583-26b9bb990eae tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:01.907718 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b9c71012-9d8b-4586-a583-26b9bb990eae tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:01.908178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b9c71012-9d8b-4586-a583-26b9bb990eae tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:01.909007 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b9c71012-9d8b-4586-a583-26b9bb990eae tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:01.910365 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b9c71012-9d8b-4586-a583-26b9bb990eae tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:02.062269 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-7fd695fe-961c-4ca6-832a-8781cd07cdfa req-943d4102-4546-4ab0-bb30-02b2d86027d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "850c462a-25ae-40e2-a43b-fdf1ec4ab8e4", "tag": "10f89cd0-bfe6-4930-8b3e-f58f898ca571"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:34:02.078515 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-7fd695fe-961c-4ca6-832a-8781cd07cdfa req-943d4102-4546-4ab0-bb30-02b2d86027d0 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:02.080265 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-7fd695fe-961c-4ca6-832a-8781cd07cdfa req-943d4102-4546-4ab0-bb30-02b2d86027d0 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:02.117726 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-7fd695fe-961c-4ca6-832a-8781cd07cdfa req-943d4102-4546-4ab0-bb30-02b2d86027d0 service nova] Creating event network-changed:10f89cd0-bfe6-4930-8b3e-f58f898ca571 for instance 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 on hv-cinder-81268 Jun 29 12:34:02.142641 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-7fd695fe-961c-4ca6-832a-8781cd07cdfa req-943d4102-4546-4ab0-bb30-02b2d86027d0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092427 Jun 29 12:34:02.145955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 57/94] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:34:02.184657 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e6a3df4d-1cb3-4d17-a60e-258e225cca89 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:02.185290 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e6a3df4d-1cb3-4d17-a60e-258e225cca89 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:02.199772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e6a3df4d-1cb3-4d17-a60e-258e225cca89 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:02.203247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e6a3df4d-1cb3-4d17-a60e-258e225cca89 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:02.204087 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e6a3df4d-1cb3-4d17-a60e-258e225cca89 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:02.207573 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e6a3df4d-1cb3-4d17-a60e-258e225cca89 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:02.242474 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b9c71012-9d8b-4586-a583-26b9bb990eae tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:02.266273 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b9c71012-9d8b-4586-a583-26b9bb990eae tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:02.276802 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b9c71012-9d8b-4586-a583-26b9bb990eae tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:02.278728 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b9c71012-9d8b-4586-a583-26b9bb990eae tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.389763 Jun 29 12:34:02.281327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 38/95] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:34:01 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:34:02.402355 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-60f28048-9ba5-48be-8b9d-45100880d29f tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:02.403043 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-60f28048-9ba5-48be-8b9d-45100880d29f tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:02.441679 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-60f28048-9ba5-48be-8b9d-45100880d29f tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:02.443910 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-60f28048-9ba5-48be-8b9d-45100880d29f tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:02.453086 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-60f28048-9ba5-48be-8b9d-45100880d29f tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:02.461583 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-60f28048-9ba5-48be-8b9d-45100880d29f tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:02.669472 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e6a3df4d-1cb3-4d17-a60e-258e225cca89 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:02.680384 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e6a3df4d-1cb3-4d17-a60e-258e225cca89 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1321 microversion: 2.1 time: 0.502450 Jun 29 12:34:02.681958 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 58/96] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:02 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1321 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:02.687380 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e3f21b66-8ad3-4e0c-8e34-31a711e9d367 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:02.689195 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e3f21b66-8ad3-4e0c-8e34-31a711e9d367 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:02.697200 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e3f21b66-8ad3-4e0c-8e34-31a711e9d367 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:02.698174 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e3f21b66-8ad3-4e0c-8e34-31a711e9d367 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:02.699361 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e3f21b66-8ad3-4e0c-8e34-31a711e9d367 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:02.700029 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e3f21b66-8ad3-4e0c-8e34-31a711e9d367 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:02.783565 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e3f21b66-8ad3-4e0c-8e34-31a711e9d367 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:02.793271 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e3f21b66-8ad3-4e0c-8e34-31a711e9d367 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1266 microversion: 2.1 time: 0.109859 Jun 29 12:34:02.796338 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 59/97] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:02 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:02.802805 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5a11220d-59bc-4409-9e32-2c3b5b9fbc57 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:02.803537 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5a11220d-59bc-4409-9e32-2c3b5b9fbc57 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:02.819209 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5a11220d-59bc-4409-9e32-2c3b5b9fbc57 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:02.819664 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5a11220d-59bc-4409-9e32-2c3b5b9fbc57 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:02.823359 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5a11220d-59bc-4409-9e32-2c3b5b9fbc57 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:02.825056 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5a11220d-59bc-4409-9e32-2c3b5b9fbc57 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:03.052618 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-60f28048-9ba5-48be-8b9d-45100880d29f tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:03.068924 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-60f28048-9ba5-48be-8b9d-45100880d29f tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1314 microversion: 2.1 time: 0.670678 Jun 29 12:34:03.069463 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 39/98] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:02 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1314 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:03.298046 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-941d9f5d-880c-4638-b7cc-05d4f03b07d8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:03.298967 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-941d9f5d-880c-4638-b7cc-05d4f03b07d8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:03.319944 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-941d9f5d-880c-4638-b7cc-05d4f03b07d8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:03.321831 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-941d9f5d-880c-4638-b7cc-05d4f03b07d8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:03.323944 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-941d9f5d-880c-4638-b7cc-05d4f03b07d8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:03.330001 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-941d9f5d-880c-4638-b7cc-05d4f03b07d8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:03.375740 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5a11220d-59bc-4409-9e32-2c3b5b9fbc57 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:03.387035 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5a11220d-59bc-4409-9e32-2c3b5b9fbc57 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1364 microversion: 2.1 time: 0.589835 Jun 29 12:34:03.387627 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 60/99] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:02 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1364 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:03.699579 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4354442d-0736-486e-8ef5-7c6faf518eb6 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:03.700227 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4354442d-0736-486e-8ef5-7c6faf518eb6 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:03.713174 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4354442d-0736-486e-8ef5-7c6faf518eb6 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:03.714029 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4354442d-0736-486e-8ef5-7c6faf518eb6 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:03.717802 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4354442d-0736-486e-8ef5-7c6faf518eb6 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:03.719079 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4354442d-0736-486e-8ef5-7c6faf518eb6 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:03.880659 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-941d9f5d-880c-4638-b7cc-05d4f03b07d8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:03.896347 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-941d9f5d-880c-4638-b7cc-05d4f03b07d8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:03.897903 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-941d9f5d-880c-4638-b7cc-05d4f03b07d8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:03.902659 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-941d9f5d-880c-4638-b7cc-05d4f03b07d8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.609326 Jun 29 12:34:03.906468 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 40/100] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:34:03 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:34:03.918041 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-503bb85c-5984-4e8e-a393-c6cac682ee2c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:03.918717 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-503bb85c-5984-4e8e-a393-c6cac682ee2c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:03.936907 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-503bb85c-5984-4e8e-a393-c6cac682ee2c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:03.937375 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-503bb85c-5984-4e8e-a393-c6cac682ee2c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:03.940374 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-503bb85c-5984-4e8e-a393-c6cac682ee2c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:03.940873 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-503bb85c-5984-4e8e-a393-c6cac682ee2c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:04.119664 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-503bb85c-5984-4e8e-a393-c6cac682ee2c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:04.137035 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-503bb85c-5984-4e8e-a393-c6cac682ee2c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1272 microversion: 2.1 time: 0.229564 Jun 29 12:34:04.148500 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 41/101] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:03 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1272 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:04.154062 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-cca3c4d6-e086-4ed3-8391-401389f20bf2 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:04.154750 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-cca3c4d6-e086-4ed3-8391-401389f20bf2 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:04.163160 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cca3c4d6-e086-4ed3-8391-401389f20bf2 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:04.166166 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cca3c4d6-e086-4ed3-8391-401389f20bf2 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:04.168254 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cca3c4d6-e086-4ed3-8391-401389f20bf2 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:04.168940 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cca3c4d6-e086-4ed3-8391-401389f20bf2 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:04.332399 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4354442d-0736-486e-8ef5-7c6faf518eb6 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:04.367364 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4354442d-0736-486e-8ef5-7c6faf518eb6 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1321 microversion: 2.1 time: 0.670335 Jun 29 12:34:04.380303 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 61/102] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:03 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1321 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:04.417356 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-65d92ee5-62e4-4c5b-8dcb-9ba55d7bf9c5 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:04.418161 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-65d92ee5-62e4-4c5b-8dcb-9ba55d7bf9c5 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:04.430899 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-65d92ee5-62e4-4c5b-8dcb-9ba55d7bf9c5 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:04.433160 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-65d92ee5-62e4-4c5b-8dcb-9ba55d7bf9c5 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:04.437665 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-65d92ee5-62e4-4c5b-8dcb-9ba55d7bf9c5 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:04.438182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-65d92ee5-62e4-4c5b-8dcb-9ba55d7bf9c5 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:04.676835 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-cca3c4d6-e086-4ed3-8391-401389f20bf2 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:04.684443 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-cca3c4d6-e086-4ed3-8391-401389f20bf2 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1314 microversion: 2.1 time: 0.534801 Jun 29 12:34:04.691236 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 42/103] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:04 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:04.716848 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-65d92ee5-62e4-4c5b-8dcb-9ba55d7bf9c5 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:04.731562 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-65d92ee5-62e4-4c5b-8dcb-9ba55d7bf9c5 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1364 microversion: 2.1 time: 0.330160 Jun 29 12:34:04.733768 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 62/104] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:04 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1364 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:04.927586 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fa2c4580-6912-451d-8230-0a9a89434a3e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:04.928689 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-fa2c4580-6912-451d-8230-0a9a89434a3e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:04.951560 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fa2c4580-6912-451d-8230-0a9a89434a3e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:04.952173 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fa2c4580-6912-451d-8230-0a9a89434a3e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:04.953834 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fa2c4580-6912-451d-8230-0a9a89434a3e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:04.955717 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fa2c4580-6912-451d-8230-0a9a89434a3e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:05.180132 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6762d857-358b-482d-92b2-5c85335c27eb tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:05.183317 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-6762d857-358b-482d-92b2-5c85335c27eb tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:05.198501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6762d857-358b-482d-92b2-5c85335c27eb tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:05.199461 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6762d857-358b-482d-92b2-5c85335c27eb tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:05.200820 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6762d857-358b-482d-92b2-5c85335c27eb tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:05.201731 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6762d857-358b-482d-92b2-5c85335c27eb tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:05.263937 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-fa2c4580-6912-451d-8230-0a9a89434a3e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:05.282321 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-fa2c4580-6912-451d-8230-0a9a89434a3e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:05.288004 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-fa2c4580-6912-451d-8230-0a9a89434a3e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:05.289178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-fa2c4580-6912-451d-8230-0a9a89434a3e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.367294 Jun 29 12:34:05.289757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 43/105] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:34:04 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:34:05.388932 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-bf848080-4664-4fb8-87af-36e2b0314aed tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:05.389943 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-bf848080-4664-4fb8-87af-36e2b0314aed tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:05.404028 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bf848080-4664-4fb8-87af-36e2b0314aed tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:05.405678 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bf848080-4664-4fb8-87af-36e2b0314aed tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:05.407026 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bf848080-4664-4fb8-87af-36e2b0314aed tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:05.409282 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bf848080-4664-4fb8-87af-36e2b0314aed tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:05.498797 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6762d857-358b-482d-92b2-5c85335c27eb tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:05.517051 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6762d857-358b-482d-92b2-5c85335c27eb tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1314 microversion: 2.1 time: 0.363891 Jun 29 12:34:05.518044 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 63/106] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:05 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:05.719991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f4a3651d-8a8d-47e8-813c-351b6c7e3b25 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:05.721528 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f4a3651d-8a8d-47e8-813c-351b6c7e3b25 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:05.730227 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f4a3651d-8a8d-47e8-813c-351b6c7e3b25 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:05.730864 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f4a3651d-8a8d-47e8-813c-351b6c7e3b25 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:05.731813 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f4a3651d-8a8d-47e8-813c-351b6c7e3b25 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:05.732408 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f4a3651d-8a8d-47e8-813c-351b6c7e3b25 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:05.941978 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f4a3651d-8a8d-47e8-813c-351b6c7e3b25 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:05.954305 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f4a3651d-8a8d-47e8-813c-351b6c7e3b25 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1314 microversion: 2.1 time: 0.237375 Jun 29 12:34:05.964244 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 64/107] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:05 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:05.978033 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-fe680051-45fd-43ef-a355-05b2301f4435 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:05.980141 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-fe680051-45fd-43ef-a355-05b2301f4435 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:05.982029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-bf848080-4664-4fb8-87af-36e2b0314aed tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:05.992786 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-bf848080-4664-4fb8-87af-36e2b0314aed tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1321 microversion: 2.1 time: 0.607997 Jun 29 12:34:06.000198 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fe680051-45fd-43ef-a355-05b2301f4435 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:06.001826 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fe680051-45fd-43ef-a355-05b2301f4435 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:06.002898 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fe680051-45fd-43ef-a355-05b2301f4435 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:06.003588 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 44/108] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:05 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1321 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:06.005526 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fe680051-45fd-43ef-a355-05b2301f4435 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:06.290993 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-fe680051-45fd-43ef-a355-05b2301f4435 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:06.299789 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-fe680051-45fd-43ef-a355-05b2301f4435 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1364 microversion: 2.1 time: 0.334376 Jun 29 12:34:06.303421 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 65/109] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:05 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1364 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:06.321508 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4f918008-b0b1-4410-97e8-32f91ca74d69 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:06.322116 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4f918008-b0b1-4410-97e8-32f91ca74d69 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:06.328741 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4f918008-b0b1-4410-97e8-32f91ca74d69 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:06.329191 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4f918008-b0b1-4410-97e8-32f91ca74d69 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:06.329954 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4f918008-b0b1-4410-97e8-32f91ca74d69 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:06.330391 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4f918008-b0b1-4410-97e8-32f91ca74d69 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:06.543383 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-cb8d4bd7-02c4-448e-8d88-3e21a6813f06 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:06.547181 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-cb8d4bd7-02c4-448e-8d88-3e21a6813f06 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:06.599102 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cb8d4bd7-02c4-448e-8d88-3e21a6813f06 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:06.601529 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cb8d4bd7-02c4-448e-8d88-3e21a6813f06 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:06.602783 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cb8d4bd7-02c4-448e-8d88-3e21a6813f06 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:06.603354 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4f918008-b0b1-4410-97e8-32f91ca74d69 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:06.609016 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cb8d4bd7-02c4-448e-8d88-3e21a6813f06 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:06.620569 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4f918008-b0b1-4410-97e8-32f91ca74d69 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:06.622217 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4f918008-b0b1-4410-97e8-32f91ca74d69 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:06.623743 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4f918008-b0b1-4410-97e8-32f91ca74d69 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.320272 Jun 29 12:34:06.624918 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 45/110] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:34:06 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:34:06.631297 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-7ca1f14e-912e-4463-9b65-671604cd6f6b req-91f46896-a2cb-46a8-bca9-f7939f4f12f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ada04fbc-eedc-4644-9540-dbbbd704eb68", "tag": "cfecd916-bdeb-4c19-8875-d60eaf0ad5d2"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:34:06.643409 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-7ca1f14e-912e-4463-9b65-671604cd6f6b req-91f46896-a2cb-46a8-bca9-f7939f4f12f0 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:06.644178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-7ca1f14e-912e-4463-9b65-671604cd6f6b req-91f46896-a2cb-46a8-bca9-f7939f4f12f0 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:06.660480 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-7ca1f14e-912e-4463-9b65-671604cd6f6b req-91f46896-a2cb-46a8-bca9-f7939f4f12f0 service nova] Creating event network-changed:cfecd916-bdeb-4c19-8875-d60eaf0ad5d2 for instance ada04fbc-eedc-4644-9540-dbbbd704eb68 on hv-cinder-81268 Jun 29 12:34:06.667552 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-7ca1f14e-912e-4463-9b65-671604cd6f6b req-91f46896-a2cb-46a8-bca9-f7939f4f12f0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040677 Jun 29 12:34:06.668995 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 46/111] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:34:06.812711 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-cb8d4bd7-02c4-448e-8d88-3e21a6813f06 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:06.822483 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-cb8d4bd7-02c4-448e-8d88-3e21a6813f06 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1314 microversion: 2.1 time: 0.291584 Jun 29 12:34:06.823055 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 66/112] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:06 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:06.973619 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-27205ea2-313b-4920-a0f4-ca690f6b312c tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:06.974334 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-27205ea2-313b-4920-a0f4-ca690f6b312c tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:06.981770 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-27205ea2-313b-4920-a0f4-ca690f6b312c tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:06.982479 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-27205ea2-313b-4920-a0f4-ca690f6b312c tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:06.984036 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-27205ea2-313b-4920-a0f4-ca690f6b312c tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:06.984655 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-27205ea2-313b-4920-a0f4-ca690f6b312c tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:07.009058 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=100 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:34:07.019825 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a34fe1e4-b65d-43d7-8b6e-61423a40fe0e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:07.021031 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a34fe1e4-b65d-43d7-8b6e-61423a40fe0e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:07.027913 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a34fe1e4-b65d-43d7-8b6e-61423a40fe0e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:07.028365 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a34fe1e4-b65d-43d7-8b6e-61423a40fe0e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:07.029127 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a34fe1e4-b65d-43d7-8b6e-61423a40fe0e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:07.029559 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a34fe1e4-b65d-43d7-8b6e-61423a40fe0e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:07.217778 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-27205ea2-313b-4920-a0f4-ca690f6b312c tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:07.237262 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-27205ea2-313b-4920-a0f4-ca690f6b312c tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1314 microversion: 2.1 time: 0.268656 Jun 29 12:34:07.238557 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 47/113] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:06 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:07.279394 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a34fe1e4-b65d-43d7-8b6e-61423a40fe0e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:07.283459 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=100 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:34:07.289567 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a34fe1e4-b65d-43d7-8b6e-61423a40fe0e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1321 microversion: 2.1 time: 0.283638 Jun 29 12:34:07.290143 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 67/114] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:07 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1321 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:07.321461 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-06e70178-a596-4566-92c6-da65b970486f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:07.325155 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-06e70178-a596-4566-92c6-da65b970486f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:07.329270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-06e70178-a596-4566-92c6-da65b970486f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:07.329717 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-06e70178-a596-4566-92c6-da65b970486f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:07.330496 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-06e70178-a596-4566-92c6-da65b970486f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:07.330934 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-06e70178-a596-4566-92c6-da65b970486f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:07.512785 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-06e70178-a596-4566-92c6-da65b970486f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:07.534085 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-06e70178-a596-4566-92c6-da65b970486f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1364 microversion: 2.1 time: 0.216801 Jun 29 12:34:07.536446 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 48/115] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:07 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:07.646208 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-61a43218-845c-4d60-bba8-cbf8517b3701 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:07.647250 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-61a43218-845c-4d60-bba8-cbf8517b3701 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:07.666023 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-61a43218-845c-4d60-bba8-cbf8517b3701 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:07.668895 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-61a43218-845c-4d60-bba8-cbf8517b3701 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:07.670405 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-61a43218-845c-4d60-bba8-cbf8517b3701 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:07.673254 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-61a43218-845c-4d60-bba8-cbf8517b3701 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:07.739892 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-c0596f5d-8d31-4dd7-b62a-8aab3d28ea74 req-451fe1c0-c9d7-4922-b0ca-cfe001a06221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6ff7e6-212e-41a7-9c74-df2c4e3a2010", "name": "network-vif-plugged", "status": "completed", "tag": "9c0824d3-f095-48c6-8750-a139a1ca3582"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:34:07.752492 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-c0596f5d-8d31-4dd7-b62a-8aab3d28ea74 req-451fe1c0-c9d7-4922-b0ca-cfe001a06221 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:07.758996 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-c0596f5d-8d31-4dd7-b62a-8aab3d28ea74 req-451fe1c0-c9d7-4922-b0ca-cfe001a06221 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:07.786545 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-c0596f5d-8d31-4dd7-b62a-8aab3d28ea74 req-451fe1c0-c9d7-4922-b0ca-cfe001a06221 service nova] Creating event network-vif-plugged:9c0824d3-f095-48c6-8750-a139a1ca3582 for instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 on hv-cinder-81268 Jun 29 12:34:07.794549 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-c0596f5d-8d31-4dd7-b62a-8aab3d28ea74 req-451fe1c0-c9d7-4922-b0ca-cfe001a06221 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.270700 Jun 29 12:34:07.796061 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 68/116] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:34:07.841172 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-98d7014c-528a-4163-ac55-c0adb42299fd tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:07.842563 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-98d7014c-528a-4163-ac55-c0adb42299fd tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:07.853302 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-98d7014c-528a-4163-ac55-c0adb42299fd tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:07.855485 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-98d7014c-528a-4163-ac55-c0adb42299fd tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:07.856846 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-98d7014c-528a-4163-ac55-c0adb42299fd tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:07.860413 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-98d7014c-528a-4163-ac55-c0adb42299fd tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:07.998013 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-61a43218-845c-4d60-bba8-cbf8517b3701 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:08.015272 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-61a43218-845c-4d60-bba8-cbf8517b3701 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:08.017511 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-61a43218-845c-4d60-bba8-cbf8517b3701 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:08.020912 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-61a43218-845c-4d60-bba8-cbf8517b3701 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.379188 Jun 29 12:34:08.033002 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 49/117] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:34:07 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:34:08.116884 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-98d7014c-528a-4163-ac55-c0adb42299fd tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:08.128588 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-98d7014c-528a-4163-ac55-c0adb42299fd tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1314 microversion: 2.1 time: 0.291674 Jun 29 12:34:08.130362 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 69/118] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:07 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:08.260984 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-85334f0a-d9c3-4932-82a7-cfda4683589d tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:08.261602 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-85334f0a-d9c3-4932-82a7-cfda4683589d tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:08.273829 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-85334f0a-d9c3-4932-82a7-cfda4683589d tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:08.274305 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-85334f0a-d9c3-4932-82a7-cfda4683589d tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:08.275114 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-85334f0a-d9c3-4932-82a7-cfda4683589d tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:08.276038 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-85334f0a-d9c3-4932-82a7-cfda4683589d tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:08.307159 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e0c46be5-557c-4a01-84ee-7f62bc43dbda tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:08.307777 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e0c46be5-557c-4a01-84ee-7f62bc43dbda tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:08.316442 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e0c46be5-557c-4a01-84ee-7f62bc43dbda tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:08.318045 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e0c46be5-557c-4a01-84ee-7f62bc43dbda tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:08.320287 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e0c46be5-557c-4a01-84ee-7f62bc43dbda tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:08.320732 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e0c46be5-557c-4a01-84ee-7f62bc43dbda tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:08.647146 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-85334f0a-d9c3-4932-82a7-cfda4683589d tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:08.657102 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-85334f0a-d9c3-4932-82a7-cfda4683589d tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1314 microversion: 2.1 time: 0.406399 Jun 29 12:34:08.658407 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 50/119] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:08 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:08.665613 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-290a4a10-de65-48d7-83dd-46a525614dec tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:08.666414 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e0c46be5-557c-4a01-84ee-7f62bc43dbda tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:08.667823 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-290a4a10-de65-48d7-83dd-46a525614dec tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:08.676899 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e0c46be5-557c-4a01-84ee-7f62bc43dbda tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1321 microversion: 2.1 time: 0.373403 Jun 29 12:34:08.681611 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 70/120] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:08 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1321 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:08.690513 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-290a4a10-de65-48d7-83dd-46a525614dec tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:08.690513 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-290a4a10-de65-48d7-83dd-46a525614dec tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:08.690513 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-290a4a10-de65-48d7-83dd-46a525614dec tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:08.690513 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-290a4a10-de65-48d7-83dd-46a525614dec tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:08.912851 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-290a4a10-de65-48d7-83dd-46a525614dec tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:08.929282 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-290a4a10-de65-48d7-83dd-46a525614dec tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1364 microversion: 2.1 time: 0.268440 Jun 29 12:34:08.931298 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 51/121] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:08 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1364 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:09.040571 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-7e2fcf8c-a2e9-412a-abf4-d1f67da61fb0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:09.041981 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-7e2fcf8c-a2e9-412a-abf4-d1f67da61fb0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:09.048389 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7e2fcf8c-a2e9-412a-abf4-d1f67da61fb0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:09.048940 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7e2fcf8c-a2e9-412a-abf4-d1f67da61fb0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:09.050199 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7e2fcf8c-a2e9-412a-abf4-d1f67da61fb0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:09.051010 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7e2fcf8c-a2e9-412a-abf4-d1f67da61fb0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:09.148698 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f69b0c18-d4c0-4e6d-8559-aa4afe617b31 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:09.149388 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f69b0c18-d4c0-4e6d-8559-aa4afe617b31 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:09.163205 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f69b0c18-d4c0-4e6d-8559-aa4afe617b31 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:09.163403 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f69b0c18-d4c0-4e6d-8559-aa4afe617b31 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:09.166752 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f69b0c18-d4c0-4e6d-8559-aa4afe617b31 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:09.168519 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f69b0c18-d4c0-4e6d-8559-aa4afe617b31 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:09.247102 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7e2fcf8c-a2e9-412a-abf4-d1f67da61fb0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:09.259489 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7e2fcf8c-a2e9-412a-abf4-d1f67da61fb0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:09.261647 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7e2fcf8c-a2e9-412a-abf4-d1f67da61fb0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:09.270519 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-7e2fcf8c-a2e9-412a-abf4-d1f67da61fb0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.228207 Jun 29 12:34:09.271302 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 71/122] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:34:09 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:34:09.367695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f69b0c18-d4c0-4e6d-8559-aa4afe617b31 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:09.376670 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f69b0c18-d4c0-4e6d-8559-aa4afe617b31 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1314 microversion: 2.1 time: 0.233980 Jun 29 12:34:09.377361 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 52/123] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:09 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:09.680250 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a9b5acad-f935-41f4-b9a1-d1c154579af5 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:09.680881 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a9b5acad-f935-41f4-b9a1-d1c154579af5 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:09.686956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a9b5acad-f935-41f4-b9a1-d1c154579af5 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:09.687412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a9b5acad-f935-41f4-b9a1-d1c154579af5 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:09.688233 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a9b5acad-f935-41f4-b9a1-d1c154579af5 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:09.688656 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a9b5acad-f935-41f4-b9a1-d1c154579af5 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:09.699164 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-61ccba6a-9e35-48ab-ba61-4ed6bb994f8e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:09.699772 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-61ccba6a-9e35-48ab-ba61-4ed6bb994f8e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:09.708677 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-61ccba6a-9e35-48ab-ba61-4ed6bb994f8e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:09.709128 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-61ccba6a-9e35-48ab-ba61-4ed6bb994f8e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:09.709889 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-61ccba6a-9e35-48ab-ba61-4ed6bb994f8e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:09.710518 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-61ccba6a-9e35-48ab-ba61-4ed6bb994f8e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:09.765274 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=6 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:34:09.836984 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a9b5acad-f935-41f4-b9a1-d1c154579af5 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:09.847781 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a9b5acad-f935-41f4-b9a1-d1c154579af5 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1314 microversion: 2.1 time: 0.170601 Jun 29 12:34:09.848832 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 72/124] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:09 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:09.869355 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-61ccba6a-9e35-48ab-ba61-4ed6bb994f8e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:09.883921 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-61ccba6a-9e35-48ab-ba61-4ed6bb994f8e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1321 microversion: 2.1 time: 0.188635 Jun 29 12:34:09.884508 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 53/125] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:09 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:09.885414 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-bc7d0d3f-b741-428b-bd6b-3cafde673916 req-a976ab28-a96f-467e-bfdb-27c02725deee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d59927-1de5-433d-8c94-5bf3aab49f49", "name": "network-vif-plugged", "status": "completed", "tag": "ab0649e0-5f8b-479c-990a-de8e68bba496"}, {"server_uuid": "f2fe6e32-c192-444c-8fa1-df3767145bc0", "name": "network-vif-plugged", "status": "completed", "tag": "1e5740b0-fd73-4bb9-8d83-8f4bdfb7b8ed"}, {"server_uuid": "850c462a-25ae-40e2-a43b-fdf1ec4ab8e4", "name": "network-vif-plugged", "status": "completed", "tag": "10f89cd0-bfe6-4930-8b3e-f58f898ca571"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:34:09.889435 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=4 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:34:09.899744 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-bc7d0d3f-b741-428b-bd6b-3cafde673916 req-a976ab28-a96f-467e-bfdb-27c02725deee service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:09.900390 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-bc7d0d3f-b741-428b-bd6b-3cafde673916 req-a976ab28-a96f-467e-bfdb-27c02725deee service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:09.915835 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-bc7d0d3f-b741-428b-bd6b-3cafde673916 req-a976ab28-a96f-467e-bfdb-27c02725deee service nova] Creating event network-vif-plugged:ab0649e0-5f8b-479c-990a-de8e68bba496 for instance d6d59927-1de5-433d-8c94-5bf3aab49f49 on hv-cinder-81268 Jun 29 12:34:09.916523 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-bc7d0d3f-b741-428b-bd6b-3cafde673916 req-a976ab28-a96f-467e-bfdb-27c02725deee service nova] Creating event network-vif-plugged:1e5740b0-fd73-4bb9-8d83-8f4bdfb7b8ed for instance f2fe6e32-c192-444c-8fa1-df3767145bc0 on hv-cinder-81268 Jun 29 12:34:09.917030 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-bc7d0d3f-b741-428b-bd6b-3cafde673916 req-a976ab28-a96f-467e-bfdb-27c02725deee service nova] Creating event network-vif-plugged:10f89cd0-bfe6-4930-8b3e-f58f898ca571 for instance 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 on hv-cinder-81268 Jun 29 12:34:09.928881 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-bc7d0d3f-b741-428b-bd6b-3cafde673916 req-a976ab28-a96f-467e-bfdb-27c02725deee service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.046916 Jun 29 12:34:09.929463 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 73/126] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:34:09.981894 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-53e470dc-c649-4e62-a88a-3cda6eac9066 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:09.983294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-53e470dc-c649-4e62-a88a-3cda6eac9066 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:09.996101 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-53e470dc-c649-4e62-a88a-3cda6eac9066 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:10.001838 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-53e470dc-c649-4e62-a88a-3cda6eac9066 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:10.003057 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-53e470dc-c649-4e62-a88a-3cda6eac9066 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:10.004423 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-53e470dc-c649-4e62-a88a-3cda6eac9066 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:10.151843 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:34:10.220433 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-53e470dc-c649-4e62-a88a-3cda6eac9066 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:10.234930 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-53e470dc-c649-4e62-a88a-3cda6eac9066 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1364 microversion: 2.1 time: 0.272823 Jun 29 12:34:10.235773 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 54/127] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:09 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1364 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:10.293740 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1c0a4a7e-e672-402a-83b9-82ad2960b7d8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:10.294626 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1c0a4a7e-e672-402a-83b9-82ad2960b7d8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:10.306410 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1c0a4a7e-e672-402a-83b9-82ad2960b7d8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:10.306984 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1c0a4a7e-e672-402a-83b9-82ad2960b7d8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:10.308392 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1c0a4a7e-e672-402a-83b9-82ad2960b7d8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:10.309021 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1c0a4a7e-e672-402a-83b9-82ad2960b7d8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:10.396253 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5e57ad51-8f62-479d-ae4f-760796a3a61f tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:10.397009 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5e57ad51-8f62-479d-ae4f-760796a3a61f tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:10.410576 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5e57ad51-8f62-479d-ae4f-760796a3a61f tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:10.411039 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5e57ad51-8f62-479d-ae4f-760796a3a61f tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:10.415527 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5e57ad51-8f62-479d-ae4f-760796a3a61f tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:10.416028 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5e57ad51-8f62-479d-ae4f-760796a3a61f tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:10.522013 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1c0a4a7e-e672-402a-83b9-82ad2960b7d8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:10.548015 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1c0a4a7e-e672-402a-83b9-82ad2960b7d8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:10.550215 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1c0a4a7e-e672-402a-83b9-82ad2960b7d8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:10.551872 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1c0a4a7e-e672-402a-83b9-82ad2960b7d8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.263446 Jun 29 12:34:10.552451 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 74/128] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:34:10 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:34:10.672959 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5e57ad51-8f62-479d-ae4f-760796a3a61f tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:10.682509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5e57ad51-8f62-479d-ae4f-760796a3a61f tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1314 microversion: 2.1 time: 0.292940 Jun 29 12:34:10.683175 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 55/129] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:10 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:10.866484 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d5933468-4be4-4e81-909f-87bfbeb76757 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:10.867430 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d5933468-4be4-4e81-909f-87bfbeb76757 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:10.873537 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d5933468-4be4-4e81-909f-87bfbeb76757 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:10.873991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d5933468-4be4-4e81-909f-87bfbeb76757 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:10.874827 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d5933468-4be4-4e81-909f-87bfbeb76757 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:10.875298 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d5933468-4be4-4e81-909f-87bfbeb76757 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:10.901452 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d4b73548-5152-4ba0-9817-0312e0bd5f79 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:10.904279 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d4b73548-5152-4ba0-9817-0312e0bd5f79 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:10.911939 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d4b73548-5152-4ba0-9817-0312e0bd5f79 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:10.912490 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d4b73548-5152-4ba0-9817-0312e0bd5f79 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:10.913339 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d4b73548-5152-4ba0-9817-0312e0bd5f79 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:10.913865 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d4b73548-5152-4ba0-9817-0312e0bd5f79 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:11.053705 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d4b73548-5152-4ba0-9817-0312e0bd5f79 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:11.064176 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d4b73548-5152-4ba0-9817-0312e0bd5f79 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1321 microversion: 2.1 time: 0.166783 Jun 29 12:34:11.064770 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 56/130] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:10 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:11.101639 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d5933468-4be4-4e81-909f-87bfbeb76757 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:11.108956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d5933468-4be4-4e81-909f-87bfbeb76757 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1314 microversion: 2.1 time: 0.247587 Jun 29 12:34:11.109522 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 75/131] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:10 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:11.254887 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e7afcf71-1514-43a8-a19d-a4c2f8d1a3c0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:11.255654 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e7afcf71-1514-43a8-a19d-a4c2f8d1a3c0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:11.261658 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e7afcf71-1514-43a8-a19d-a4c2f8d1a3c0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:11.262130 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e7afcf71-1514-43a8-a19d-a4c2f8d1a3c0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:11.262902 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e7afcf71-1514-43a8-a19d-a4c2f8d1a3c0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:11.263337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e7afcf71-1514-43a8-a19d-a4c2f8d1a3c0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:11.407362 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e7afcf71-1514-43a8-a19d-a4c2f8d1a3c0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:11.416693 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e7afcf71-1514-43a8-a19d-a4c2f8d1a3c0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1364 microversion: 2.1 time: 0.168134 Jun 29 12:34:11.417425 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 57/132] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:11 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:11.570407 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-54b38faa-eab8-4af1-bf91-75b33bcd73ee tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:11.571220 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-54b38faa-eab8-4af1-bf91-75b33bcd73ee tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:11.577304 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-54b38faa-eab8-4af1-bf91-75b33bcd73ee tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:11.577755 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-54b38faa-eab8-4af1-bf91-75b33bcd73ee tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:11.578553 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-54b38faa-eab8-4af1-bf91-75b33bcd73ee tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:11.579161 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-54b38faa-eab8-4af1-bf91-75b33bcd73ee tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:11.704103 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ab352612-933b-486a-87d1-7efc4686a0f5 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:11.704823 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ab352612-933b-486a-87d1-7efc4686a0f5 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:11.713208 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ab352612-933b-486a-87d1-7efc4686a0f5 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:11.713669 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ab352612-933b-486a-87d1-7efc4686a0f5 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:11.714673 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ab352612-933b-486a-87d1-7efc4686a0f5 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:11.715161 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ab352612-933b-486a-87d1-7efc4686a0f5 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:11.773566 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-54b38faa-eab8-4af1-bf91-75b33bcd73ee tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:11.782081 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-54b38faa-eab8-4af1-bf91-75b33bcd73ee tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:11.783628 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-54b38faa-eab8-4af1-bf91-75b33bcd73ee tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:11.785267 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-54b38faa-eab8-4af1-bf91-75b33bcd73ee tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.218809 Jun 29 12:34:11.785832 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 76/133] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:34:11 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:34:11.938908 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ab352612-933b-486a-87d1-7efc4686a0f5 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:11.947097 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ab352612-933b-486a-87d1-7efc4686a0f5 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1314 microversion: 2.1 time: 0.247857 Jun 29 12:34:11.947756 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 58/134] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:11 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:12.086391 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-dd188648-3626-4c96-b15e-60674e1b5138 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:12.087106 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-dd188648-3626-4c96-b15e-60674e1b5138 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:12.095010 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dd188648-3626-4c96-b15e-60674e1b5138 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:12.095539 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dd188648-3626-4c96-b15e-60674e1b5138 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:12.097152 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dd188648-3626-4c96-b15e-60674e1b5138 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:12.097328 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dd188648-3626-4c96-b15e-60674e1b5138 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:12.125012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-28dea2af-8492-4b56-ba3f-5b757dd10d0f tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:12.125990 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-28dea2af-8492-4b56-ba3f-5b757dd10d0f tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:12.141201 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-28dea2af-8492-4b56-ba3f-5b757dd10d0f tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:12.141674 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-28dea2af-8492-4b56-ba3f-5b757dd10d0f tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:12.142546 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-28dea2af-8492-4b56-ba3f-5b757dd10d0f tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:12.142988 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-28dea2af-8492-4b56-ba3f-5b757dd10d0f tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:12.295268 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-dd188648-3626-4c96-b15e-60674e1b5138 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:12.303939 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-dd188648-3626-4c96-b15e-60674e1b5138 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1321 microversion: 2.1 time: 0.224403 Jun 29 12:34:12.310411 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 77/135] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:12 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:12.321870 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-28dea2af-8492-4b56-ba3f-5b757dd10d0f tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:12.329824 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-28dea2af-8492-4b56-ba3f-5b757dd10d0f tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1314 microversion: 2.1 time: 0.208578 Jun 29 12:34:12.330374 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 59/136] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:12 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:12.437367 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-2038ab7e-018c-47e1-89d1-d5f7d5fd2de2 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:12.438247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-2038ab7e-018c-47e1-89d1-d5f7d5fd2de2 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:12.445872 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2038ab7e-018c-47e1-89d1-d5f7d5fd2de2 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:12.446269 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2038ab7e-018c-47e1-89d1-d5f7d5fd2de2 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:12.447073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2038ab7e-018c-47e1-89d1-d5f7d5fd2de2 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:12.447511 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2038ab7e-018c-47e1-89d1-d5f7d5fd2de2 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:12.589932 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2038ab7e-018c-47e1-89d1-d5f7d5fd2de2 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:12.598505 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-2038ab7e-018c-47e1-89d1-d5f7d5fd2de2 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1364 microversion: 2.1 time: 0.165510 Jun 29 12:34:12.599207 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 78/137] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:12 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:12.803255 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6a13e203-af1a-4f78-b283-5fbb9bfd6fd1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:12.803899 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6a13e203-af1a-4f78-b283-5fbb9bfd6fd1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:12.811163 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6a13e203-af1a-4f78-b283-5fbb9bfd6fd1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:12.811903 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6a13e203-af1a-4f78-b283-5fbb9bfd6fd1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:12.812894 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6a13e203-af1a-4f78-b283-5fbb9bfd6fd1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:12.813342 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6a13e203-af1a-4f78-b283-5fbb9bfd6fd1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:12.866830 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-c8dcb7ca-8bf9-4b41-96e0-77be0388606a req-908c491b-e08c-4b26-873f-888e2c41d763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d615c3d2-4ba0-41e9-be7e-8e51d8e36b86", "name": "network-vif-plugged", "status": "completed", "tag": "c73e8ec9-3797-428f-82d9-0808363d1eab"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:34:12.879850 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-c8dcb7ca-8bf9-4b41-96e0-77be0388606a req-908c491b-e08c-4b26-873f-888e2c41d763 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:12.891117 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-c8dcb7ca-8bf9-4b41-96e0-77be0388606a req-908c491b-e08c-4b26-873f-888e2c41d763 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:12.908886 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-c8dcb7ca-8bf9-4b41-96e0-77be0388606a req-908c491b-e08c-4b26-873f-888e2c41d763 service nova] Creating event network-vif-plugged:c73e8ec9-3797-428f-82d9-0808363d1eab for instance d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 on hv-cinder-81268 Jun 29 12:34:12.917148 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-c8dcb7ca-8bf9-4b41-96e0-77be0388606a req-908c491b-e08c-4b26-873f-888e2c41d763 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055576 Jun 29 12:34:12.918612 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 79/138] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:34:12.968893 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9f58133b-c855-4642-9db8-7b0b27b076f9 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:12.969594 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-9f58133b-c855-4642-9db8-7b0b27b076f9 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:12.977932 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9f58133b-c855-4642-9db8-7b0b27b076f9 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:12.978395 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9f58133b-c855-4642-9db8-7b0b27b076f9 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:12.979343 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9f58133b-c855-4642-9db8-7b0b27b076f9 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:12.979785 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9f58133b-c855-4642-9db8-7b0b27b076f9 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:12.992382 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6a13e203-af1a-4f78-b283-5fbb9bfd6fd1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:13.006087 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6a13e203-af1a-4f78-b283-5fbb9bfd6fd1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:13.007965 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6a13e203-af1a-4f78-b283-5fbb9bfd6fd1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:13.009130 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6a13e203-af1a-4f78-b283-5fbb9bfd6fd1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.210459 Jun 29 12:34:13.009679 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 60/139] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:34:12 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:34:13.133353 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-9f58133b-c855-4642-9db8-7b0b27b076f9 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:13.139555 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-9f58133b-c855-4642-9db8-7b0b27b076f9 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1314 microversion: 2.1 time: 0.176717 Jun 29 12:34:13.140230 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 80/140] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:12 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:13.321260 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e6d8ac84-5e11-4853-8c1d-d9479fe65b79 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:13.321866 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e6d8ac84-5e11-4853-8c1d-d9479fe65b79 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:13.328009 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e6d8ac84-5e11-4853-8c1d-d9479fe65b79 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:13.328576 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e6d8ac84-5e11-4853-8c1d-d9479fe65b79 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:13.329198 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e6d8ac84-5e11-4853-8c1d-d9479fe65b79 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:13.329637 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e6d8ac84-5e11-4853-8c1d-d9479fe65b79 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:13.351969 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5f4cc864-6937-411d-b625-c71679be529b tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:13.352763 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5f4cc864-6937-411d-b625-c71679be529b tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:13.359097 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5f4cc864-6937-411d-b625-c71679be529b tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:13.359594 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5f4cc864-6937-411d-b625-c71679be529b tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:13.360466 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5f4cc864-6937-411d-b625-c71679be529b tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:13.361010 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5f4cc864-6937-411d-b625-c71679be529b tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:13.470219 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e6d8ac84-5e11-4853-8c1d-d9479fe65b79 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:13.479950 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e6d8ac84-5e11-4853-8c1d-d9479fe65b79 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1321 microversion: 2.1 time: 0.162377 Jun 29 12:34:13.486463 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 61/141] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:13 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:13.513821 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5f4cc864-6937-411d-b625-c71679be529b tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:13.521974 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5f4cc864-6937-411d-b625-c71679be529b tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1314 microversion: 2.1 time: 0.177305 Jun 29 12:34:13.522572 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 81/142] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:13 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:13.616047 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8be9fd30-7ce2-4319-8ab0-482ea22515bf tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:13.616667 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8be9fd30-7ce2-4319-8ab0-482ea22515bf tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:13.622596 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8be9fd30-7ce2-4319-8ab0-482ea22515bf tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:13.623158 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8be9fd30-7ce2-4319-8ab0-482ea22515bf tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:13.623922 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8be9fd30-7ce2-4319-8ab0-482ea22515bf tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:13.624363 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8be9fd30-7ce2-4319-8ab0-482ea22515bf tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:13.768326 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8be9fd30-7ce2-4319-8ab0-482ea22515bf tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:13.777563 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8be9fd30-7ce2-4319-8ab0-482ea22515bf tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1364 microversion: 2.1 time: 0.166067 Jun 29 12:34:13.778150 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 62/143] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:13 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:14.032362 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-2f9b9141-91c0-42fe-b252-0fbcb2a43b39 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:14.032973 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-2f9b9141-91c0-42fe-b252-0fbcb2a43b39 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:14.036918 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:34:14.041826 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2f9b9141-91c0-42fe-b252-0fbcb2a43b39 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:14.042272 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2f9b9141-91c0-42fe-b252-0fbcb2a43b39 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:14.043102 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2f9b9141-91c0-42fe-b252-0fbcb2a43b39 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:14.043533 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2f9b9141-91c0-42fe-b252-0fbcb2a43b39 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:14.159975 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4013dfce-065e-462b-8e2b-c7e972ea7cfe tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:14.160938 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4013dfce-065e-462b-8e2b-c7e972ea7cfe tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:14.170883 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4013dfce-065e-462b-8e2b-c7e972ea7cfe tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:14.181986 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4013dfce-065e-462b-8e2b-c7e972ea7cfe tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:14.183793 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4013dfce-065e-462b-8e2b-c7e972ea7cfe tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:14.184435 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4013dfce-065e-462b-8e2b-c7e972ea7cfe tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:14.213131 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2f9b9141-91c0-42fe-b252-0fbcb2a43b39 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:14.226940 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2f9b9141-91c0-42fe-b252-0fbcb2a43b39 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:14.235008 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2f9b9141-91c0-42fe-b252-0fbcb2a43b39 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:14.236171 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-2f9b9141-91c0-42fe-b252-0fbcb2a43b39 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.211994 Jun 29 12:34:14.236757 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 82/144] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:34:14 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:34:14.349844 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4013dfce-065e-462b-8e2b-c7e972ea7cfe tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:14.359421 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4013dfce-065e-462b-8e2b-c7e972ea7cfe tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1314 microversion: 2.1 time: 0.203102 Jun 29 12:34:14.371548 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 63/145] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:14 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:14.497197 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f86b4b1e-be46-4807-89e0-5193ba518a44 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:14.497871 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f86b4b1e-be46-4807-89e0-5193ba518a44 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:14.504759 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f86b4b1e-be46-4807-89e0-5193ba518a44 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:14.505203 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f86b4b1e-be46-4807-89e0-5193ba518a44 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:14.505977 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f86b4b1e-be46-4807-89e0-5193ba518a44 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:14.506482 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f86b4b1e-be46-4807-89e0-5193ba518a44 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:14.538703 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2f3c1b96-0bcb-488e-a8ff-ff11a0e01abb tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:14.539350 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2f3c1b96-0bcb-488e-a8ff-ff11a0e01abb tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:14.547475 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2f3c1b96-0bcb-488e-a8ff-ff11a0e01abb tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:14.548319 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2f3c1b96-0bcb-488e-a8ff-ff11a0e01abb tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:14.549332 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2f3c1b96-0bcb-488e-a8ff-ff11a0e01abb tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:14.550328 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2f3c1b96-0bcb-488e-a8ff-ff11a0e01abb tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:14.554784 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=100 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:34:14.650045 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f86b4b1e-be46-4807-89e0-5193ba518a44 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:14.657661 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f86b4b1e-be46-4807-89e0-5193ba518a44 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1321 microversion: 2.1 time: 0.164546 Jun 29 12:34:14.658438 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 83/146] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:14 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:14.695568 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2f3c1b96-0bcb-488e-a8ff-ff11a0e01abb tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:14.704014 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2f3c1b96-0bcb-488e-a8ff-ff11a0e01abb tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1502 microversion: 2.1 time: 0.168907 Jun 29 12:34:14.704811 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 64/147] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:14 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:14.795087 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a77f1396-ee9d-4dcb-83eb-3a2b518f762c tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:14.796192 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a77f1396-ee9d-4dcb-83eb-3a2b518f762c tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:14.803640 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a77f1396-ee9d-4dcb-83eb-3a2b518f762c tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:14.804311 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a77f1396-ee9d-4dcb-83eb-3a2b518f762c tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:14.805427 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a77f1396-ee9d-4dcb-83eb-3a2b518f762c tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:14.806299 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a77f1396-ee9d-4dcb-83eb-3a2b518f762c tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:14.988135 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a77f1396-ee9d-4dcb-83eb-3a2b518f762c tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:14.999593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a77f1396-ee9d-4dcb-83eb-3a2b518f762c tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1364 microversion: 2.1 time: 0.207263 Jun 29 12:34:15.002508 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 84/148] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:14 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:15.253200 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b0536a5f-882e-4300-8ddc-1f17f3b1d1b6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:15.254094 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b0536a5f-882e-4300-8ddc-1f17f3b1d1b6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:15.260105 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b0536a5f-882e-4300-8ddc-1f17f3b1d1b6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:15.260559 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b0536a5f-882e-4300-8ddc-1f17f3b1d1b6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:15.261336 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b0536a5f-882e-4300-8ddc-1f17f3b1d1b6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:15.261773 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b0536a5f-882e-4300-8ddc-1f17f3b1d1b6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:15.381382 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9e4de189-74cf-4146-a7e4-7528badc1437 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:15.382124 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-9e4de189-74cf-4146-a7e4-7528badc1437 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:15.388369 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9e4de189-74cf-4146-a7e4-7528badc1437 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:15.389031 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9e4de189-74cf-4146-a7e4-7528badc1437 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:15.389790 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9e4de189-74cf-4146-a7e4-7528badc1437 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:15.390374 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9e4de189-74cf-4146-a7e4-7528badc1437 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:15.407927 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b0536a5f-882e-4300-8ddc-1f17f3b1d1b6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:15.420463 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b0536a5f-882e-4300-8ddc-1f17f3b1d1b6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:15.422227 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b0536a5f-882e-4300-8ddc-1f17f3b1d1b6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:15.423395 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b0536a5f-882e-4300-8ddc-1f17f3b1d1b6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.174277 Jun 29 12:34:15.423935 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 65/149] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:34:15 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:34:15.535236 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-9e4de189-74cf-4146-a7e4-7528badc1437 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:15.542667 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-9e4de189-74cf-4146-a7e4-7528badc1437 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1314 microversion: 2.1 time: 0.166516 Jun 29 12:34:15.543378 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 85/150] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:15 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:15.676480 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b868eb6a-e808-4a69-8afc-4079f260c1ff tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:15.677463 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b868eb6a-e808-4a69-8afc-4079f260c1ff tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:15.683568 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b868eb6a-e808-4a69-8afc-4079f260c1ff tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:15.684051 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b868eb6a-e808-4a69-8afc-4079f260c1ff tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:15.684820 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b868eb6a-e808-4a69-8afc-4079f260c1ff tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:15.685261 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b868eb6a-e808-4a69-8afc-4079f260c1ff tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:15.822114 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b868eb6a-e808-4a69-8afc-4079f260c1ff tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:15.842056 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b868eb6a-e808-4a69-8afc-4079f260c1ff tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1321 microversion: 2.1 time: 0.170263 Jun 29 12:34:15.845529 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 66/151] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:15 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:16.017047 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-bde75734-38f5-49cb-9251-9b7583334233 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:16.017605 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-bde75734-38f5-49cb-9251-9b7583334233 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:16.023962 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bde75734-38f5-49cb-9251-9b7583334233 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:16.024417 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bde75734-38f5-49cb-9251-9b7583334233 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:16.025185 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bde75734-38f5-49cb-9251-9b7583334233 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:16.025627 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bde75734-38f5-49cb-9251-9b7583334233 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:16.043269 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=100 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:34:16.164310 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-bde75734-38f5-49cb-9251-9b7583334233 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:16.172470 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-bde75734-38f5-49cb-9251-9b7583334233 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1364 microversion: 2.1 time: 0.159361 Jun 29 12:34:16.173175 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 86/152] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:16 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:16.441510 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4a1b39e9-a235-4461-a6d9-a123e9eea307 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:16.442120 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4a1b39e9-a235-4461-a6d9-a123e9eea307 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:16.448115 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4a1b39e9-a235-4461-a6d9-a123e9eea307 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:16.448556 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4a1b39e9-a235-4461-a6d9-a123e9eea307 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:16.449319 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4a1b39e9-a235-4461-a6d9-a123e9eea307 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:16.449766 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4a1b39e9-a235-4461-a6d9-a123e9eea307 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:16.560764 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-33636bcf-ff25-4ef3-8709-8560f19de366 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:16.561975 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-33636bcf-ff25-4ef3-8709-8560f19de366 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:16.569692 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-33636bcf-ff25-4ef3-8709-8560f19de366 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:16.570486 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-33636bcf-ff25-4ef3-8709-8560f19de366 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:16.571579 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-33636bcf-ff25-4ef3-8709-8560f19de366 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:16.572015 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-33636bcf-ff25-4ef3-8709-8560f19de366 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:16.587565 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4a1b39e9-a235-4461-a6d9-a123e9eea307 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:16.596759 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4a1b39e9-a235-4461-a6d9-a123e9eea307 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:16.598485 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4a1b39e9-a235-4461-a6d9-a123e9eea307 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:16.600030 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4a1b39e9-a235-4461-a6d9-a123e9eea307 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.162953 Jun 29 12:34:16.601094 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 67/153] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:34:16 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:34:16.709636 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-33636bcf-ff25-4ef3-8709-8560f19de366 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:16.717585 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-33636bcf-ff25-4ef3-8709-8560f19de366 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1314 microversion: 2.1 time: 0.160904 Jun 29 12:34:16.718313 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 87/154] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:16 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:16.861791 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f63c1d2d-0a53-47e4-b42b-21be443ffb33 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:16.863044 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f63c1d2d-0a53-47e4-b42b-21be443ffb33 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:16.869779 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f63c1d2d-0a53-47e4-b42b-21be443ffb33 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:16.870282 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f63c1d2d-0a53-47e4-b42b-21be443ffb33 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:16.871095 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f63c1d2d-0a53-47e4-b42b-21be443ffb33 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:16.871526 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f63c1d2d-0a53-47e4-b42b-21be443ffb33 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:17.007561 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f63c1d2d-0a53-47e4-b42b-21be443ffb33 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:17.015210 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f63c1d2d-0a53-47e4-b42b-21be443ffb33 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1321 microversion: 2.1 time: 0.157460 Jun 29 12:34:17.015767 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 68/155] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:16 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:17.190131 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8623cae7-b7b5-4bb1-aea2-ac24b09491d5 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:17.191500 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8623cae7-b7b5-4bb1-aea2-ac24b09491d5 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:17.197770 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8623cae7-b7b5-4bb1-aea2-ac24b09491d5 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:17.198215 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8623cae7-b7b5-4bb1-aea2-ac24b09491d5 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:17.199204 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8623cae7-b7b5-4bb1-aea2-ac24b09491d5 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:17.199838 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8623cae7-b7b5-4bb1-aea2-ac24b09491d5 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:17.340322 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8623cae7-b7b5-4bb1-aea2-ac24b09491d5 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:17.348405 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8623cae7-b7b5-4bb1-aea2-ac24b09491d5 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1364 microversion: 2.1 time: 0.161944 Jun 29 12:34:17.348979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 88/156] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:17 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:17.591805 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-bf13aef9-e0bf-4ceb-859a-ca221ddee9ee req-99a7bbd8-ae72-4b59-8c60-4a385d80d2de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ada04fbc-eedc-4644-9540-dbbbd704eb68", "name": "network-vif-plugged", "status": "completed", "tag": "cfecd916-bdeb-4c19-8875-d60eaf0ad5d2"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:34:17.602236 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-bf13aef9-e0bf-4ceb-859a-ca221ddee9ee req-99a7bbd8-ae72-4b59-8c60-4a385d80d2de service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:17.602826 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-bf13aef9-e0bf-4ceb-859a-ca221ddee9ee req-99a7bbd8-ae72-4b59-8c60-4a385d80d2de service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:17.619261 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ae680ebe-4952-4f26-a26d-3bfda5961d5e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:17.619946 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ae680ebe-4952-4f26-a26d-3bfda5961d5e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:17.627989 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-bf13aef9-e0bf-4ceb-859a-ca221ddee9ee req-99a7bbd8-ae72-4b59-8c60-4a385d80d2de service nova] Creating event network-vif-plugged:cfecd916-bdeb-4c19-8875-d60eaf0ad5d2 for instance ada04fbc-eedc-4644-9540-dbbbd704eb68 on hv-cinder-81268 Jun 29 12:34:17.631785 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ae680ebe-4952-4f26-a26d-3bfda5961d5e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:17.632325 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ae680ebe-4952-4f26-a26d-3bfda5961d5e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:17.634201 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ae680ebe-4952-4f26-a26d-3bfda5961d5e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:17.634390 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-bf13aef9-e0bf-4ceb-859a-ca221ddee9ee req-99a7bbd8-ae72-4b59-8c60-4a385d80d2de service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048057 Jun 29 12:34:17.635086 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 69/157] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:34:17.635575 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ae680ebe-4952-4f26-a26d-3bfda5961d5e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:17.736478 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fe07ae20-a63f-4185-9903-80b6f530ab99 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:17.737902 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-fe07ae20-a63f-4185-9903-80b6f530ab99 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:17.744499 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fe07ae20-a63f-4185-9903-80b6f530ab99 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:17.744949 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fe07ae20-a63f-4185-9903-80b6f530ab99 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:17.745917 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fe07ae20-a63f-4185-9903-80b6f530ab99 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:17.746408 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fe07ae20-a63f-4185-9903-80b6f530ab99 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:17.798967 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ae680ebe-4952-4f26-a26d-3bfda5961d5e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:17.808427 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ae680ebe-4952-4f26-a26d-3bfda5961d5e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:17.809871 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ae680ebe-4952-4f26-a26d-3bfda5961d5e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:17.811161 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ae680ebe-4952-4f26-a26d-3bfda5961d5e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.196193 Jun 29 12:34:17.811736 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 89/158] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:34:17 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:34:17.903033 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-fe07ae20-a63f-4185-9903-80b6f530ab99 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:17.910874 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-fe07ae20-a63f-4185-9903-80b6f530ab99 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1314 microversion: 2.1 time: 0.179722 Jun 29 12:34:17.911441 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 70/159] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:17 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:18.034736 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5a7c5e66-f1cf-47be-8e4f-cab858037831 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:18.035492 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5a7c5e66-f1cf-47be-8e4f-cab858037831 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:18.041968 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5a7c5e66-f1cf-47be-8e4f-cab858037831 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:18.042447 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5a7c5e66-f1cf-47be-8e4f-cab858037831 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:18.043232 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5a7c5e66-f1cf-47be-8e4f-cab858037831 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:18.043671 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5a7c5e66-f1cf-47be-8e4f-cab858037831 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:18.175533 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5a7c5e66-f1cf-47be-8e4f-cab858037831 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:18.183079 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5a7c5e66-f1cf-47be-8e4f-cab858037831 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1321 microversion: 2.1 time: 0.152500 Jun 29 12:34:18.183640 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 90/160] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:18 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:18.366296 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3cc02c00-ab2d-4f9b-8b8a-007366ddc99d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:18.366858 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3cc02c00-ab2d-4f9b-8b8a-007366ddc99d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:18.372863 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3cc02c00-ab2d-4f9b-8b8a-007366ddc99d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:18.373314 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3cc02c00-ab2d-4f9b-8b8a-007366ddc99d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:18.374121 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3cc02c00-ab2d-4f9b-8b8a-007366ddc99d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:18.374539 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3cc02c00-ab2d-4f9b-8b8a-007366ddc99d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:18.508157 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3cc02c00-ab2d-4f9b-8b8a-007366ddc99d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:18.515512 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3cc02c00-ab2d-4f9b-8b8a-007366ddc99d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1364 microversion: 2.1 time: 0.154184 Jun 29 12:34:18.516067 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 71/161] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:18 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:18.835366 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5154f652-2855-4761-9559-1af4917aa565 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:18.838536 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5154f652-2855-4761-9559-1af4917aa565 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:18.847570 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5154f652-2855-4761-9559-1af4917aa565 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:18.852552 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5154f652-2855-4761-9559-1af4917aa565 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:18.852552 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5154f652-2855-4761-9559-1af4917aa565 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:18.852552 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5154f652-2855-4761-9559-1af4917aa565 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:18.932386 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-13cd5a7c-98ee-4487-93fb-67fc45e80062 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:18.933450 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-13cd5a7c-98ee-4487-93fb-67fc45e80062 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:18.943837 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-13cd5a7c-98ee-4487-93fb-67fc45e80062 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:18.944394 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-13cd5a7c-98ee-4487-93fb-67fc45e80062 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:18.945510 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-13cd5a7c-98ee-4487-93fb-67fc45e80062 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:18.946140 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-13cd5a7c-98ee-4487-93fb-67fc45e80062 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:18.995179 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5154f652-2855-4761-9559-1af4917aa565 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:19.003438 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5154f652-2855-4761-9559-1af4917aa565 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:19.005120 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5154f652-2855-4761-9559-1af4917aa565 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:19.006362 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5154f652-2855-4761-9559-1af4917aa565 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.179468 Jun 29 12:34:19.007027 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 91/162] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:34:18 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:34:19.076499 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-13cd5a7c-98ee-4487-93fb-67fc45e80062 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:19.085915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-13cd5a7c-98ee-4487-93fb-67fc45e80062 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1314 microversion: 2.1 time: 0.162385 Jun 29 12:34:19.086509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 72/163] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:18 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:19.200776 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-eb123115-4233-49ca-b2fd-6bc176f47499 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:19.201410 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-eb123115-4233-49ca-b2fd-6bc176f47499 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:19.208346 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-eb123115-4233-49ca-b2fd-6bc176f47499 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:19.208795 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-eb123115-4233-49ca-b2fd-6bc176f47499 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:19.209585 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-eb123115-4233-49ca-b2fd-6bc176f47499 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:19.210019 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-eb123115-4233-49ca-b2fd-6bc176f47499 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:19.338147 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fc863d48-c74f-493a-b84f-e8479c687ae6 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56acc5dc-a486-4026-bd4f-f5b7bdd80379"}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:34:19.339292 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-fc863d48-c74f-493a-b84f-e8479c687ae6 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:19.342316 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-eb123115-4233-49ca-b2fd-6bc176f47499 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:19.348657 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=100 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:34:19.350132 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-eb123115-4233-49ca-b2fd-6bc176f47499 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1321 microversion: 2.1 time: 0.153540 Jun 29 12:34:19.350804 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 92/164] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:19 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:19.352321 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fc863d48-c74f-493a-b84f-e8479c687ae6 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:19.352773 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fc863d48-c74f-493a-b84f-e8479c687ae6 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:19.353544 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fc863d48-c74f-493a-b84f-e8479c687ae6 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:19.354010 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fc863d48-c74f-493a-b84f-e8479c687ae6 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:19.533516 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4650975a-7fe9-487b-97bd-9f8e1c07ec96 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:19.534968 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4650975a-7fe9-487b-97bd-9f8e1c07ec96 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:19.541626 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4650975a-7fe9-487b-97bd-9f8e1c07ec96 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:19.542172 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4650975a-7fe9-487b-97bd-9f8e1c07ec96 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:19.543064 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4650975a-7fe9-487b-97bd-9f8e1c07ec96 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:19.543568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4650975a-7fe9-487b-97bd-9f8e1c07ec96 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:19.674095 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4650975a-7fe9-487b-97bd-9f8e1c07ec96 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:19.682166 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4650975a-7fe9-487b-97bd-9f8e1c07ec96 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1551 microversion: 2.1 time: 0.152684 Jun 29 12:34:19.682760 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 93/165] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:19 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1551 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:19.698855 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4a5b8ae6-72fb-4dda-b967-62185d3a4ac6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:19.699344 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4a5b8ae6-72fb-4dda-b967-62185d3a4ac6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:19.705110 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4a5b8ae6-72fb-4dda-b967-62185d3a4ac6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:19.705559 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4a5b8ae6-72fb-4dda-b967-62185d3a4ac6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:19.706929 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4a5b8ae6-72fb-4dda-b967-62185d3a4ac6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:19.707418 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4a5b8ae6-72fb-4dda-b967-62185d3a4ac6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:19.822271 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4a5b8ae6-72fb-4dda-b967-62185d3a4ac6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.126924 Jun 29 12:34:19.822928 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 94/166] 10.222.0.52 () {58 vars in 1274 bytes} [Wed Jun 29 12:34:19 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:34:20.025841 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d60c84f0-19d4-4675-b15e-ed93c801674e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:20.026463 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d60c84f0-19d4-4675-b15e-ed93c801674e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:20.036210 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d60c84f0-19d4-4675-b15e-ed93c801674e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:20.037097 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d60c84f0-19d4-4675-b15e-ed93c801674e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:20.039068 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d60c84f0-19d4-4675-b15e-ed93c801674e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:20.039637 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d60c84f0-19d4-4675-b15e-ed93c801674e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:20.216628 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d60c84f0-19d4-4675-b15e-ed93c801674e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:20.229297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d60c84f0-19d4-4675-b15e-ed93c801674e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:20.232048 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d60c84f0-19d4-4675-b15e-ed93c801674e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:20.233496 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d60c84f0-19d4-4675-b15e-ed93c801674e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.212136 Jun 29 12:34:20.234159 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 95/167] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:34:20 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:34:20.251350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-26d09970-7ecb-4c20-a6a6-6e491e70cdbf tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:20.252113 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-26d09970-7ecb-4c20-a6a6-6e491e70cdbf tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:20.259517 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-26d09970-7ecb-4c20-a6a6-6e491e70cdbf tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:20.260038 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-26d09970-7ecb-4c20-a6a6-6e491e70cdbf tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:20.261562 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-26d09970-7ecb-4c20-a6a6-6e491e70cdbf tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:20.262081 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-26d09970-7ecb-4c20-a6a6-6e491e70cdbf tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:20.468475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-26d09970-7ecb-4c20-a6a6-6e491e70cdbf tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:20.477074 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-26d09970-7ecb-4c20-a6a6-6e491e70cdbf tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1314 microversion: 2.1 time: 0.241586 Jun 29 12:34:20.477928 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 96/168] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:20 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:20.494260 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ac51327a-e97f-4b8b-bb2b-81a057c1120a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:20.494925 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ac51327a-e97f-4b8b-bb2b-81a057c1120a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:20.500961 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ac51327a-e97f-4b8b-bb2b-81a057c1120a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:20.501408 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ac51327a-e97f-4b8b-bb2b-81a057c1120a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:20.502360 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ac51327a-e97f-4b8b-bb2b-81a057c1120a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:20.503242 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ac51327a-e97f-4b8b-bb2b-81a057c1120a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:20.657612 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ac51327a-e97f-4b8b-bb2b-81a057c1120a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:20.668494 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ac51327a-e97f-4b8b-bb2b-81a057c1120a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1321 microversion: 2.1 time: 0.177691 Jun 29 12:34:20.680082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 97/169] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:20 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:21.254268 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6deb47b4-c63b-42b2-977e-93caf3178b87 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:21.255181 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-6deb47b4-c63b-42b2-977e-93caf3178b87 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:21.263848 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6deb47b4-c63b-42b2-977e-93caf3178b87 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:21.264435 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6deb47b4-c63b-42b2-977e-93caf3178b87 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:21.265513 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6deb47b4-c63b-42b2-977e-93caf3178b87 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:21.266988 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6deb47b4-c63b-42b2-977e-93caf3178b87 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:21.289934 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-fc863d48-c74f-493a-b84f-e8479c687ae6 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "POST /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.955601 Jun 29 12:34:21.291258 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 73/170] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Jun 29 12:34:19 2022] POST /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010/os-volume_attachments => generated 194 bytes in 1957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:34:21.429707 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6deb47b4-c63b-42b2-977e-93caf3178b87 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:21.437522 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6deb47b4-c63b-42b2-977e-93caf3178b87 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:21.439047 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6deb47b4-c63b-42b2-977e-93caf3178b87 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:21.440416 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6deb47b4-c63b-42b2-977e-93caf3178b87 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.192036 Jun 29 12:34:21.440970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 98/171] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:34:21 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:34:21.495745 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-360048f4-9310-4b45-9be0-01c59b466ad6 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:21.496840 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-360048f4-9310-4b45-9be0-01c59b466ad6 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:21.511733 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-360048f4-9310-4b45-9be0-01c59b466ad6 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:21.513238 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-360048f4-9310-4b45-9be0-01c59b466ad6 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:21.514967 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-360048f4-9310-4b45-9be0-01c59b466ad6 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:21.515578 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-360048f4-9310-4b45-9be0-01c59b466ad6 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:21.555826 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-56c374d9-d25d-4414-b4bd-dd6cc65f8727 req-ec45e0c0-07a2-483f-96a9-aa417a1071e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "850c462a-25ae-40e2-a43b-fdf1ec4ab8e4", "tag": "10f89cd0-bfe6-4930-8b3e-f58f898ca571"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:34:21.565775 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-56c374d9-d25d-4414-b4bd-dd6cc65f8727 req-ec45e0c0-07a2-483f-96a9-aa417a1071e3 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:21.566558 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-56c374d9-d25d-4414-b4bd-dd6cc65f8727 req-ec45e0c0-07a2-483f-96a9-aa417a1071e3 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:21.578826 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-56c374d9-d25d-4414-b4bd-dd6cc65f8727 req-ec45e0c0-07a2-483f-96a9-aa417a1071e3 service nova] Creating event network-changed:10f89cd0-bfe6-4930-8b3e-f58f898ca571 for instance 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 on hv-cinder-81268 Jun 29 12:34:21.585008 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-56c374d9-d25d-4414-b4bd-dd6cc65f8727 req-ec45e0c0-07a2-483f-96a9-aa417a1071e3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035599 Jun 29 12:34:21.585806 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 99/172] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:34:21.685741 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-15a05108-46ff-4ffc-bcbb-60f54f090619 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:21.686756 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-15a05108-46ff-4ffc-bcbb-60f54f090619 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:21.694844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-15a05108-46ff-4ffc-bcbb-60f54f090619 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:21.695538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-15a05108-46ff-4ffc-bcbb-60f54f090619 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:21.696534 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-15a05108-46ff-4ffc-bcbb-60f54f090619 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:21.696819 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-360048f4-9310-4b45-9be0-01c59b466ad6 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:21.697304 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-15a05108-46ff-4ffc-bcbb-60f54f090619 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:21.704473 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-360048f4-9310-4b45-9be0-01c59b466ad6 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1314 microversion: 2.1 time: 0.213690 Jun 29 12:34:21.705041 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 74/173] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:21 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:21.841302 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-15a05108-46ff-4ffc-bcbb-60f54f090619 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:21.852492 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-15a05108-46ff-4ffc-bcbb-60f54f090619 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1515 microversion: 2.1 time: 0.169907 Jun 29 12:34:21.865209 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 100/174] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:21 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:21.870100 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-01631b38-0e60-4cf5-ae68-6cd83ce1c294 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:34:21.871138 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-01631b38-0e60-4cf5-ae68-6cd83ce1c294 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:21.881745 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-01631b38-0e60-4cf5-ae68-6cd83ce1c294 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:21.882451 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-01631b38-0e60-4cf5-ae68-6cd83ce1c294 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:21.883381 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-01631b38-0e60-4cf5-ae68-6cd83ce1c294 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:21.883822 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-01631b38-0e60-4cf5-ae68-6cd83ce1c294 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:21.911958 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-01631b38-0e60-4cf5-ae68-6cd83ce1c294 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lazy-loading 'flavor' on Instance uuid d6d59927-1de5-433d-8c94-5bf3aab49f49 {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 12:34:22.064383 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-01631b38-0e60-4cf5-ae68-6cd83ce1c294 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "POST /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49/action" status: 200 len: 32 microversion: 2.1 time: 0.198300 Jun 29 12:34:22.065094 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 75/175] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 12:34:21 2022] POST /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49/action => generated 32 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 29 12:34:22.076159 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f5308685-4868-4c1c-88be-2094d7e1e5d3 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:22.077122 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f5308685-4868-4c1c-88be-2094d7e1e5d3 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:22.085243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f5308685-4868-4c1c-88be-2094d7e1e5d3 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:22.085933 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f5308685-4868-4c1c-88be-2094d7e1e5d3 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:22.087366 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f5308685-4868-4c1c-88be-2094d7e1e5d3 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:22.087810 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f5308685-4868-4c1c-88be-2094d7e1e5d3 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:22.238209 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f5308685-4868-4c1c-88be-2094d7e1e5d3 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:22.249451 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f5308685-4868-4c1c-88be-2094d7e1e5d3 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.177804 Jun 29 12:34:22.250357 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 101/176] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:22 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:22.459164 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e4725bb3-e438-48c4-9bfc-7c44e3295192 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:22.460453 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e4725bb3-e438-48c4-9bfc-7c44e3295192 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:22.468653 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e4725bb3-e438-48c4-9bfc-7c44e3295192 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:22.469108 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e4725bb3-e438-48c4-9bfc-7c44e3295192 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:22.470454 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e4725bb3-e438-48c4-9bfc-7c44e3295192 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:22.470994 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e4725bb3-e438-48c4-9bfc-7c44e3295192 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:22.657799 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e4725bb3-e438-48c4-9bfc-7c44e3295192 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:22.666782 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e4725bb3-e438-48c4-9bfc-7c44e3295192 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:22.668364 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e4725bb3-e438-48c4-9bfc-7c44e3295192 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:22.669396 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e4725bb3-e438-48c4-9bfc-7c44e3295192 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.215067 Jun 29 12:34:22.669947 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 76/177] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:34:22 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:34:22.721369 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-2625d358-8d5c-47f9-9767-3dca614438e6 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:22.729744 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-2625d358-8d5c-47f9-9767-3dca614438e6 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:22.741361 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2625d358-8d5c-47f9-9767-3dca614438e6 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:22.741817 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2625d358-8d5c-47f9-9767-3dca614438e6 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:22.743058 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2625d358-8d5c-47f9-9767-3dca614438e6 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:22.743505 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2625d358-8d5c-47f9-9767-3dca614438e6 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:22.959468 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2625d358-8d5c-47f9-9767-3dca614438e6 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:22.971132 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-2625d358-8d5c-47f9-9767-3dca614438e6 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1314 microversion: 2.1 time: 0.253027 Jun 29 12:34:22.972365 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 102/178] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:22 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:23.269121 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-eef429fe-1598-47a4-ada9-415328d6bd50 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:23.270030 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-eef429fe-1598-47a4-ada9-415328d6bd50 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:23.277362 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eef429fe-1598-47a4-ada9-415328d6bd50 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:23.277808 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eef429fe-1598-47a4-ada9-415328d6bd50 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:23.278684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eef429fe-1598-47a4-ada9-415328d6bd50 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:23.279005 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eef429fe-1598-47a4-ada9-415328d6bd50 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:23.659058 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-eef429fe-1598-47a4-ada9-415328d6bd50 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:23.671981 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-eef429fe-1598-47a4-ada9-415328d6bd50 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.408318 Jun 29 12:34:23.672784 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 77/179] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:23 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:23.687884 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0d03e58e-69b6-45f9-9d65-d03571dc9f83 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:23.688488 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0d03e58e-69b6-45f9-9d65-d03571dc9f83 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:23.695638 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0d03e58e-69b6-45f9-9d65-d03571dc9f83 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:23.696085 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0d03e58e-69b6-45f9-9d65-d03571dc9f83 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:23.705977 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0d03e58e-69b6-45f9-9d65-d03571dc9f83 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:23.706655 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0d03e58e-69b6-45f9-9d65-d03571dc9f83 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:23.854382 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0d03e58e-69b6-45f9-9d65-d03571dc9f83 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:23.864720 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0d03e58e-69b6-45f9-9d65-d03571dc9f83 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:23.866366 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0d03e58e-69b6-45f9-9d65-d03571dc9f83 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:23.868651 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0d03e58e-69b6-45f9-9d65-d03571dc9f83 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.184788 Jun 29 12:34:23.869307 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 103/180] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:34:23 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:34:23.989108 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-31d78ce8-3e93-4f71-8143-c75d5b6d9cb6 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:23.989718 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-31d78ce8-3e93-4f71-8143-c75d5b6d9cb6 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:23.996009 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-31d78ce8-3e93-4f71-8143-c75d5b6d9cb6 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:23.996459 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-31d78ce8-3e93-4f71-8143-c75d5b6d9cb6 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:23.997213 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-31d78ce8-3e93-4f71-8143-c75d5b6d9cb6 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:23.997677 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-31d78ce8-3e93-4f71-8143-c75d5b6d9cb6 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:24.002313 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:34:24.208534 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-31d78ce8-3e93-4f71-8143-c75d5b6d9cb6 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:24.215852 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-31d78ce8-3e93-4f71-8143-c75d5b6d9cb6 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1314 microversion: 2.1 time: 0.230996 Jun 29 12:34:24.225715 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 78/181] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:23 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:24.689874 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4add3784-2c23-4b5a-93fc-46df42a52b6d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:24.690580 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4add3784-2c23-4b5a-93fc-46df42a52b6d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:24.696610 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4add3784-2c23-4b5a-93fc-46df42a52b6d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:24.697099 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4add3784-2c23-4b5a-93fc-46df42a52b6d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:24.697857 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4add3784-2c23-4b5a-93fc-46df42a52b6d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:24.698294 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4add3784-2c23-4b5a-93fc-46df42a52b6d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:24.702295 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=100 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:34:24.833027 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4add3784-2c23-4b5a-93fc-46df42a52b6d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:24.841214 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4add3784-2c23-4b5a-93fc-46df42a52b6d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.155529 Jun 29 12:34:24.841796 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 104/182] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:24 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:24.887385 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-750ce8ff-a361-4b82-9d8d-9af955506114 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:24.888782 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-750ce8ff-a361-4b82-9d8d-9af955506114 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:24.897514 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-750ce8ff-a361-4b82-9d8d-9af955506114 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:24.897964 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-750ce8ff-a361-4b82-9d8d-9af955506114 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:24.898792 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-750ce8ff-a361-4b82-9d8d-9af955506114 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:24.899227 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-750ce8ff-a361-4b82-9d8d-9af955506114 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:25.038845 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-750ce8ff-a361-4b82-9d8d-9af955506114 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:25.047445 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-750ce8ff-a361-4b82-9d8d-9af955506114 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:25.048959 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-750ce8ff-a361-4b82-9d8d-9af955506114 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:25.050283 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-750ce8ff-a361-4b82-9d8d-9af955506114 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1406 microversion: 2.20 time: 0.166719 Jun 29 12:34:25.050994 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 79/183] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:34:24 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:34:25.234501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-2b44b08f-18db-4fd4-9438-24750c5eb1af tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:25.235624 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-2b44b08f-18db-4fd4-9438-24750c5eb1af tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:25.242635 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2b44b08f-18db-4fd4-9438-24750c5eb1af tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:25.243306 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2b44b08f-18db-4fd4-9438-24750c5eb1af tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:25.244084 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2b44b08f-18db-4fd4-9438-24750c5eb1af tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:25.244587 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2b44b08f-18db-4fd4-9438-24750c5eb1af tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:25.423112 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2b44b08f-18db-4fd4-9438-24750c5eb1af tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:25.432804 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-2b44b08f-18db-4fd4-9438-24750c5eb1af tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1314 microversion: 2.1 time: 0.202501 Jun 29 12:34:25.433377 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 105/184] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:25 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:25.863181 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b27a0004-2442-4df9-b206-e0bc415fbeb2 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:25.864211 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b27a0004-2442-4df9-b206-e0bc415fbeb2 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:25.872461 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b27a0004-2442-4df9-b206-e0bc415fbeb2 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:25.872571 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b27a0004-2442-4df9-b206-e0bc415fbeb2 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:25.873278 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b27a0004-2442-4df9-b206-e0bc415fbeb2 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:25.873713 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b27a0004-2442-4df9-b206-e0bc415fbeb2 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:26.032769 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b27a0004-2442-4df9-b206-e0bc415fbeb2 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:26.041269 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b27a0004-2442-4df9-b206-e0bc415fbeb2 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.185093 Jun 29 12:34:26.041927 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 80/185] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:25 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:26.068832 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f70226bb-f32e-482e-a9a8-a634eb71e24e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:26.069764 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f70226bb-f32e-482e-a9a8-a634eb71e24e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:26.076379 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f70226bb-f32e-482e-a9a8-a634eb71e24e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:26.077263 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f70226bb-f32e-482e-a9a8-a634eb71e24e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:26.078492 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f70226bb-f32e-482e-a9a8-a634eb71e24e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:26.079319 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f70226bb-f32e-482e-a9a8-a634eb71e24e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:26.283054 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f70226bb-f32e-482e-a9a8-a634eb71e24e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:26.294521 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f70226bb-f32e-482e-a9a8-a634eb71e24e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:26.297190 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f70226bb-f32e-482e-a9a8-a634eb71e24e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:26.298983 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f70226bb-f32e-482e-a9a8-a634eb71e24e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1597 microversion: 2.20 time: 0.234778 Jun 29 12:34:26.300916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 106/186] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:34:26 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1597 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:34:26.320312 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4e715504-913b-41af-86ce-a8a2b560a6e4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:26.320312 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4e715504-913b-41af-86ce-a8a2b560a6e4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:26.339799 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4e715504-913b-41af-86ce-a8a2b560a6e4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:26.340397 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4e715504-913b-41af-86ce-a8a2b560a6e4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:26.341289 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4e715504-913b-41af-86ce-a8a2b560a6e4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:26.343160 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4e715504-913b-41af-86ce-a8a2b560a6e4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:26.440785 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4e715504-913b-41af-86ce-a8a2b560a6e4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.124445 Jun 29 12:34:26.441961 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 81/187] 10.222.0.52 () {60 vars in 1315 bytes} [Wed Jun 29 12:34:26 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 12:34:26.459191 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-7ff85cfc-c570-4247-8cd2-9168b81b8811 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:26.459806 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-7ff85cfc-c570-4247-8cd2-9168b81b8811 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:26.476842 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7ff85cfc-c570-4247-8cd2-9168b81b8811 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:26.479436 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7ff85cfc-c570-4247-8cd2-9168b81b8811 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:26.482791 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7ff85cfc-c570-4247-8cd2-9168b81b8811 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:26.484522 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7ff85cfc-c570-4247-8cd2-9168b81b8811 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:26.769931 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7ff85cfc-c570-4247-8cd2-9168b81b8811 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:26.780555 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-7ff85cfc-c570-4247-8cd2-9168b81b8811 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1497 microversion: 2.1 time: 0.333189 Jun 29 12:34:26.781168 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 107/188] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:26 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1497 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:27.060929 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2bf71183-9a2b-43c9-93fe-9a8569c860d4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:27.061555 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2bf71183-9a2b-43c9-93fe-9a8569c860d4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:27.069993 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2bf71183-9a2b-43c9-93fe-9a8569c860d4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:27.071025 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2bf71183-9a2b-43c9-93fe-9a8569c860d4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:27.072310 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2bf71183-9a2b-43c9-93fe-9a8569c860d4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:27.073096 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2bf71183-9a2b-43c9-93fe-9a8569c860d4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:27.542917 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2bf71183-9a2b-43c9-93fe-9a8569c860d4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:27.552364 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2bf71183-9a2b-43c9-93fe-9a8569c860d4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.497066 Jun 29 12:34:27.553401 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 82/189] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:27 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:27.695216 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-fa4dbb18-90d6-425e-8a3f-706bf2c00d1f tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:27.697097 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-fa4dbb18-90d6-425e-8a3f-706bf2c00d1f tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:27.705054 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fa4dbb18-90d6-425e-8a3f-706bf2c00d1f tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:27.705790 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fa4dbb18-90d6-425e-8a3f-706bf2c00d1f tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:27.706866 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fa4dbb18-90d6-425e-8a3f-706bf2c00d1f tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:27.707686 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fa4dbb18-90d6-425e-8a3f-706bf2c00d1f tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:27.749121 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-fa4dbb18-90d6-425e-8a3f-706bf2c00d1f tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Going to try to terminate instance {{(pid=124317) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 12:34:27.897333 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-fa4dbb18-90d6-425e-8a3f-706bf2c00d1f tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 204 len: 0 microversion: 2.1 time: 0.209399 Jun 29 12:34:27.898136 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 108/190] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:34:27 2022] DELETE /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 12:34:27.911005 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c90ec774-91aa-4dfb-9319-00032ebfd962 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:27.911871 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c90ec774-91aa-4dfb-9319-00032ebfd962 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:27.926213 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c90ec774-91aa-4dfb-9319-00032ebfd962 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:27.927861 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c90ec774-91aa-4dfb-9319-00032ebfd962 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:27.929749 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c90ec774-91aa-4dfb-9319-00032ebfd962 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:27.930958 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c90ec774-91aa-4dfb-9319-00032ebfd962 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:28.248532 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c90ec774-91aa-4dfb-9319-00032ebfd962 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:28.256789 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c90ec774-91aa-4dfb-9319-00032ebfd962 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1503 microversion: 2.1 time: 0.352162 Jun 29 12:34:28.257894 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 83/191] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:27 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1503 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:28.571930 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-18d4309e-fed2-420e-8019-eddf55fe2033 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:28.572625 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-18d4309e-fed2-420e-8019-eddf55fe2033 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:28.579666 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-18d4309e-fed2-420e-8019-eddf55fe2033 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:28.580110 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-18d4309e-fed2-420e-8019-eddf55fe2033 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:28.581693 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-18d4309e-fed2-420e-8019-eddf55fe2033 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:28.582121 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-18d4309e-fed2-420e-8019-eddf55fe2033 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:28.657901 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-165e00e3-23f1-4c96-9d5c-b94b48ad950b req-689080e7-9fcb-45f3-bafc-e7e9b4b09299 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d615c3d2-4ba0-41e9-be7e-8e51d8e36b86", "tag": "c73e8ec9-3797-428f-82d9-0808363d1eab"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:34:28.667216 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-165e00e3-23f1-4c96-9d5c-b94b48ad950b req-689080e7-9fcb-45f3-bafc-e7e9b4b09299 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:28.667673 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-165e00e3-23f1-4c96-9d5c-b94b48ad950b req-689080e7-9fcb-45f3-bafc-e7e9b4b09299 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:28.685282 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-165e00e3-23f1-4c96-9d5c-b94b48ad950b req-689080e7-9fcb-45f3-bafc-e7e9b4b09299 service nova] Creating event network-changed:c73e8ec9-3797-428f-82d9-0808363d1eab for instance d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 on hv-cinder-81268 Jun 29 12:34:28.691970 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-165e00e3-23f1-4c96-9d5c-b94b48ad950b req-689080e7-9fcb-45f3-bafc-e7e9b4b09299 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037162 Jun 29 12:34:28.692914 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 84/192] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:34:28.736122 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-18d4309e-fed2-420e-8019-eddf55fe2033 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:28.746443 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-18d4309e-fed2-420e-8019-eddf55fe2033 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.179235 Jun 29 12:34:28.747026 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 109/193] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:28 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:29.276661 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-093cb998-9053-44cf-abda-ea36b534e949 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:29.277367 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-093cb998-9053-44cf-abda-ea36b534e949 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:29.284137 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-093cb998-9053-44cf-abda-ea36b534e949 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:29.284584 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-093cb998-9053-44cf-abda-ea36b534e949 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:29.285353 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-093cb998-9053-44cf-abda-ea36b534e949 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:29.285785 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-093cb998-9053-44cf-abda-ea36b534e949 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:29.428841 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-093cb998-9053-44cf-abda-ea36b534e949 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:29.437482 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-093cb998-9053-44cf-abda-ea36b534e949 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1503 microversion: 2.1 time: 0.165690 Jun 29 12:34:29.438315 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 85/194] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:29 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:29.763467 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-278aae04-720a-4f69-8f22-856855259b8c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:29.764078 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-278aae04-720a-4f69-8f22-856855259b8c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:29.770624 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-278aae04-720a-4f69-8f22-856855259b8c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:29.771074 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-278aae04-720a-4f69-8f22-856855259b8c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:29.771834 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-278aae04-720a-4f69-8f22-856855259b8c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:29.772271 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-278aae04-720a-4f69-8f22-856855259b8c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:29.906756 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-278aae04-720a-4f69-8f22-856855259b8c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:29.915103 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-278aae04-720a-4f69-8f22-856855259b8c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.155581 Jun 29 12:34:29.916761 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 110/195] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:29 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:30.455567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5ea54a66-dc6e-483a-ab92-0c678335cc96 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:30.456266 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5ea54a66-dc6e-483a-ab92-0c678335cc96 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:30.462733 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5ea54a66-dc6e-483a-ab92-0c678335cc96 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:30.463187 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5ea54a66-dc6e-483a-ab92-0c678335cc96 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:30.464043 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5ea54a66-dc6e-483a-ab92-0c678335cc96 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:30.464385 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5ea54a66-dc6e-483a-ab92-0c678335cc96 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:30.598621 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5ea54a66-dc6e-483a-ab92-0c678335cc96 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:30.606377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5ea54a66-dc6e-483a-ab92-0c678335cc96 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1503 microversion: 2.1 time: 0.154709 Jun 29 12:34:30.606971 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 86/196] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:30 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:30.933561 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ec56ea15-4266-4c04-8cf3-ca16852dd532 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:30.934162 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ec56ea15-4266-4c04-8cf3-ca16852dd532 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:30.941053 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ec56ea15-4266-4c04-8cf3-ca16852dd532 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:30.941585 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ec56ea15-4266-4c04-8cf3-ca16852dd532 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:30.942348 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ec56ea15-4266-4c04-8cf3-ca16852dd532 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:30.942804 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ec56ea15-4266-4c04-8cf3-ca16852dd532 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:31.077621 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ec56ea15-4266-4c04-8cf3-ca16852dd532 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:31.086099 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ec56ea15-4266-4c04-8cf3-ca16852dd532 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.156665 Jun 29 12:34:31.086807 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 111/197] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:30 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:31.623727 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-33dedf96-6fa5-4e29-9135-43c29e3a679a tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:31.624249 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-33dedf96-6fa5-4e29-9135-43c29e3a679a tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:31.631065 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-33dedf96-6fa5-4e29-9135-43c29e3a679a tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:31.631521 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-33dedf96-6fa5-4e29-9135-43c29e3a679a tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:31.632295 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-33dedf96-6fa5-4e29-9135-43c29e3a679a tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:31.632768 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-33dedf96-6fa5-4e29-9135-43c29e3a679a tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:31.763562 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-33dedf96-6fa5-4e29-9135-43c29e3a679a tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:31.772265 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-33dedf96-6fa5-4e29-9135-43c29e3a679a tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1503 microversion: 2.1 time: 0.152392 Jun 29 12:34:31.772897 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 87/198] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:31 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:32.103711 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-517cd356-ee9f-4cdf-9115-ba1354d2f412 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:32.104321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-517cd356-ee9f-4cdf-9115-ba1354d2f412 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:32.110292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-517cd356-ee9f-4cdf-9115-ba1354d2f412 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:32.110775 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-517cd356-ee9f-4cdf-9115-ba1354d2f412 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:32.111536 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-517cd356-ee9f-4cdf-9115-ba1354d2f412 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:32.112005 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-517cd356-ee9f-4cdf-9115-ba1354d2f412 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:32.256161 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-517cd356-ee9f-4cdf-9115-ba1354d2f412 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:32.263775 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-517cd356-ee9f-4cdf-9115-ba1354d2f412 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.163916 Jun 29 12:34:32.264336 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 112/199] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:32 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:32.791880 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fa594af5-d0ed-464e-ae18-d338cd6ac746 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:32.792417 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-fa594af5-d0ed-464e-ae18-d338cd6ac746 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:32.799302 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fa594af5-d0ed-464e-ae18-d338cd6ac746 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:32.799766 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fa594af5-d0ed-464e-ae18-d338cd6ac746 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:32.800548 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fa594af5-d0ed-464e-ae18-d338cd6ac746 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:32.800983 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fa594af5-d0ed-464e-ae18-d338cd6ac746 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:33.176025 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-fa594af5-d0ed-464e-ae18-d338cd6ac746 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:33.183555 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-fa594af5-d0ed-464e-ae18-d338cd6ac746 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1503 microversion: 2.1 time: 0.395732 Jun 29 12:34:33.184362 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 88/200] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:32 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1503 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:33.281629 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-37c66fa1-6fe8-4e92-8154-5b65fdc3b8d4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:33.282887 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-37c66fa1-6fe8-4e92-8154-5b65fdc3b8d4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:33.290442 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-37c66fa1-6fe8-4e92-8154-5b65fdc3b8d4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:33.291205 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-37c66fa1-6fe8-4e92-8154-5b65fdc3b8d4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:33.292013 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-37c66fa1-6fe8-4e92-8154-5b65fdc3b8d4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:33.292448 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-37c66fa1-6fe8-4e92-8154-5b65fdc3b8d4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:33.501477 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-37c66fa1-6fe8-4e92-8154-5b65fdc3b8d4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:33.513143 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-37c66fa1-6fe8-4e92-8154-5b65fdc3b8d4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.235944 Jun 29 12:34:33.515096 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 113/201] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:33 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:33.531515 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-f06e1567-c937-42e4-96df-43bc7a435b70 req-c8541231-e001-4c25-8ae5-0fa8d6354232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ada04fbc-eedc-4644-9540-dbbbd704eb68", "name": "network-vif-deleted", "tag": "cfecd916-bdeb-4c19-8875-d60eaf0ad5d2"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:34:33.543802 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-f06e1567-c937-42e4-96df-43bc7a435b70 req-c8541231-e001-4c25-8ae5-0fa8d6354232 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:33.544258 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-f06e1567-c937-42e4-96df-43bc7a435b70 req-c8541231-e001-4c25-8ae5-0fa8d6354232 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:33.556671 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-f06e1567-c937-42e4-96df-43bc7a435b70 req-c8541231-e001-4c25-8ae5-0fa8d6354232 service nova] Creating event network-vif-deleted:cfecd916-bdeb-4c19-8875-d60eaf0ad5d2 for instance ada04fbc-eedc-4644-9540-dbbbd704eb68 on hv-cinder-81268 Jun 29 12:34:33.561811 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-f06e1567-c937-42e4-96df-43bc7a435b70 req-c8541231-e001-4c25-8ae5-0fa8d6354232 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035730 Jun 29 12:34:33.562779 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 89/202] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:34:34.200811 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3f95eaae-149f-4636-a569-98781c1d084e tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:34.201413 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3f95eaae-149f-4636-a569-98781c1d084e tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:34.207856 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3f95eaae-149f-4636-a569-98781c1d084e tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:34.208296 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3f95eaae-149f-4636-a569-98781c1d084e tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:34.209041 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3f95eaae-149f-4636-a569-98781c1d084e tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:34.209465 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3f95eaae-149f-4636-a569-98781c1d084e tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:34.271129 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3f95eaae-149f-4636-a569-98781c1d084e tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:34.279327 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3f95eaae-149f-4636-a569-98781c1d084e tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1461 microversion: 2.1 time: 0.082329 Jun 29 12:34:34.279939 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 114/203] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:34 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1461 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:34.533167 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b796a439-7f58-45ce-b449-55f168daf4d3 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:34.534405 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b796a439-7f58-45ce-b449-55f168daf4d3 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:34.541167 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b796a439-7f58-45ce-b449-55f168daf4d3 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:34.541625 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b796a439-7f58-45ce-b449-55f168daf4d3 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:34.542396 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b796a439-7f58-45ce-b449-55f168daf4d3 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:34.542865 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b796a439-7f58-45ce-b449-55f168daf4d3 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:34.691862 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b796a439-7f58-45ce-b449-55f168daf4d3 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:34.700690 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b796a439-7f58-45ce-b449-55f168daf4d3 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.171703 Jun 29 12:34:34.701266 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 90/204] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:34 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:35.297138 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-98cecce8-ee8b-4675-b4a4-81071debd60b tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:35.297670 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-98cecce8-ee8b-4675-b4a4-81071debd60b tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:35.305755 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-98cecce8-ee8b-4675-b4a4-81071debd60b tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:35.306360 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-98cecce8-ee8b-4675-b4a4-81071debd60b tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:35.307381 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-98cecce8-ee8b-4675-b4a4-81071debd60b tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:35.308049 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-98cecce8-ee8b-4675-b4a4-81071debd60b tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:35.345556 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-98cecce8-ee8b-4675-b4a4-81071debd60b tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:35.346704 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-98cecce8-ee8b-4675-b4a4-81071debd60b tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:35.347225 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-98cecce8-ee8b-4675-b4a4-81071debd60b tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lazy-loading 'fault' on Instance uuid ada04fbc-eedc-4644-9540-dbbbd704eb68 {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 12:34:35.434196 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-98cecce8-ee8b-4675-b4a4-81071debd60b tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:35.443488 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-98cecce8-ee8b-4675-b4a4-81071debd60b tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 200 len: 1304 microversion: 2.1 time: 0.150239 Jun 29 12:34:35.444081 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 115/205] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:35 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 1304 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:35.719086 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-30fe3f7c-20bf-4c3f-8e51-9b7234440716 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:35.719682 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-30fe3f7c-20bf-4c3f-8e51-9b7234440716 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:35.726793 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-30fe3f7c-20bf-4c3f-8e51-9b7234440716 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:35.727243 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-30fe3f7c-20bf-4c3f-8e51-9b7234440716 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:35.728071 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-30fe3f7c-20bf-4c3f-8e51-9b7234440716 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:35.728517 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-30fe3f7c-20bf-4c3f-8e51-9b7234440716 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:35.878026 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-30fe3f7c-20bf-4c3f-8e51-9b7234440716 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:35.887997 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-30fe3f7c-20bf-4c3f-8e51-9b7234440716 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.172619 Jun 29 12:34:35.900312 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 91/206] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:35 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:36.433169 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a7d0f727-6458-4879-b075-328ca62e91b4 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:36.434178 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a7d0f727-6458-4879-b075-328ca62e91b4 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:36.441407 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a7d0f727-6458-4879-b075-328ca62e91b4 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:36.442332 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a7d0f727-6458-4879-b075-328ca62e91b4 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:36.443624 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a7d0f727-6458-4879-b075-328ca62e91b4 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:36.444824 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a7d0f727-6458-4879-b075-328ca62e91b4 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:36.463129 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-981bd16f-46a1-458f-b035-c610bc68f5b4 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:36.464424 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-981bd16f-46a1-458f-b035-c610bc68f5b4 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: ada04fbc-eedc-4644-9540-dbbbd704eb68] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:36.475153 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-981bd16f-46a1-458f-b035-c610bc68f5b4 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:36.475968 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-981bd16f-46a1-458f-b035-c610bc68f5b4 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:36.477360 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-981bd16f-46a1-458f-b035-c610bc68f5b4 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:36.478238 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-981bd16f-46a1-458f-b035-c610bc68f5b4 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:36.479152 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a7d0f727-6458-4879-b075-328ca62e91b4 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Going to try to terminate instance {{(pid=124317) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 12:34:36.496829 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-981bd16f-46a1-458f-b035-c610bc68f5b4 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] HTTP exception thrown: Instance ada04fbc-eedc-4644-9540-dbbbd704eb68 could not be found. Jun 29 12:34:36.502652 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-981bd16f-46a1-458f-b035-c610bc68f5b4 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Request method failure captured: Jun 29 12:34:36.502652 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 HTTP/1.1 Jun 29 12:34:36.502652 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept: application/json Jun 29 12:34:36.502652 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jun 29 12:34:36.502652 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Connection: close Jun 29 12:34:36.502652 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jun 29 12:34:36.502652 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jun 29 12:34:36.502652 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Host: 10.222.0.52 Jun 29 12:34:36.502652 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jun 29 12:34:36.502652 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jun 29 12:34:36.502652 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivEazlg7ttPVLC6BkABJXoUM6gwlpNX3HggDiXmhybAwG9e_NEoBQgnwXAfZhqoUYmiGy58pUkA6-jpPcrU1e6QldustBRo7tOlzUhs9kW-3inZ1RhFCDiYY42tarIyeDm4Ba7HhalUxiaXkbn8viA5hpHSypuqtqLCDXE-pmMA50ldw Jun 29 12:34:36.502652 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jun 29 12:34:36.502652 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jun 29 12:34:36.502652 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jun 29 12:34:36.502652 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jun 29 12:34:36.502652 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jun 29 12:34:36.502652 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jun 29 12:34:36.502652 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Id: ed93385ff03f4672acc79e103ffcb82e Jun 29 12:34:36.502652 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-VolumesActionsTest-2028320997 Jun 29 12:34:36.502652 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jun 29 12:34:36.502652 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jun 29 12:34:36.503879 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ed93385ff03f4672acc79e103ffcb82e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ed93385ff03f4672acc79e103ffcb82e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed93385ff03f4672acc79e103ffcb82e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed93385ff03f4672acc79e103ffcb82e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:34:36.503879 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-VolumesActionsTest-2028320997 Jun 29 12:34:36.503879 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Id: ed93385ff03f4672acc79e103ffcb82e Jun 29 12:34:36.503879 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-VolumesActionsTest-2028320997 Jun 29 12:34:36.503879 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User: tempest-VolumesActionsTest-2028320997-project Jun 29 12:34:36.503879 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jun 29 12:34:36.503879 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jun 29 12:34:36.503879 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Id: bba6a17fc19645c29fce6fa655095a0a Jun 29 12:34:36.503879 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-VolumesActionsTest-2028320997-project Jun 29 12:34:36.503879 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: method: > Jun 29 12:34:36.503879 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: exception: Instance ada04fbc-eedc-4644-9540-dbbbd704eb68 could not be found. Jun 29 12:34:36.503879 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: action_args: {'id': 'ada04fbc-eedc-4644-9540-dbbbd704eb68'} Jun 29 12:34:36.504633 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:34:36.504633 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:34:36.504633 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:34:36.504633 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:34:36.504633 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:34:36.504633 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:34:36.504633 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:34:36.504633 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:34:36.504633 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:34:36.504633 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:34:36.504633 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ada04fbc-eedc-4644-9540-dbbbd704eb68 could not be found. Jun 29 12:34:36.504633 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:34:36.504633 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:34:36.504633 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:34:36.504633 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:34:36.504633 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:34:36.504633 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:34:36.504633 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:34:36.504633 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:34:36.504633 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:34:36.505730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:34:36.505730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:34:36.505730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:34:36.505730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:34:36.505730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:34:36.505730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:34:36.505730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:34:36.505730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ada04fbc-eedc-4644-9540-dbbbd704eb68 could not be found. Jun 29 12:34:36.505730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:34:36.505730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:34:36.505730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:34:36.505730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:34:36.505730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:34:36.505730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:34:36.505730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:34:36.505730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:34:36.505730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ada04fbc-eedc-4644-9540-dbbbd704eb68 could not be found. Jun 29 12:34:36.505730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:34:36.510846 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-981bd16f-46a1-458f-b035-c610bc68f5b4 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Returning 404 to user: Instance ada04fbc-eedc-4644-9540-dbbbd704eb68 could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:34:36.511961 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-981bd16f-46a1-458f-b035-c610bc68f5b4 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68" status: 404 len: 111 microversion: 2.1 time: 0.053124 Jun 29 12:34:36.512643 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 92/207] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:36 2022] GET /compute/v2.1/servers/ada04fbc-eedc-4644-9540-dbbbd704eb68 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 12:34:36.576428 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a7d0f727-6458-4879-b075-328ca62e91b4 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 204 len: 0 microversion: 2.1 time: 0.148775 Jun 29 12:34:36.578461 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 116/208] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:34:36 2022] DELETE /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 12:34:36.592095 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-28334415-834f-44cc-8b0a-88c7a48115b3 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:36.592745 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-28334415-834f-44cc-8b0a-88c7a48115b3 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:36.599822 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-28334415-834f-44cc-8b0a-88c7a48115b3 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:36.600271 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-28334415-834f-44cc-8b0a-88c7a48115b3 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:36.601536 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-28334415-834f-44cc-8b0a-88c7a48115b3 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:36.602124 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-28334415-834f-44cc-8b0a-88c7a48115b3 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:36.698093 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c2cf1af1-1b6f-41af-ab7d-82b7298e27cb tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-240424653", "imageRef": "70887696-f652-46b0-a5be-bfb400986078", "flavorRef": "452", "networks": [{"uuid": "953cb3ea-ea04-4857-b87d-b4cc7d724de7"}]}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:34:36.768860 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.network.neutron [None req-c2cf1af1-1b6f-41af-ab7d-82b7298e27cb tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] validate_networks() for [('953cb3ea-ea04-4857-b87d-b4cc7d724de7', None, None, None, None, None)] {{(pid=124317) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 12:34:36.873527 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-28334415-834f-44cc-8b0a-88c7a48115b3 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:36.886387 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-28334415-834f-44cc-8b0a-88c7a48115b3 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1554 microversion: 2.1 time: 0.303721 Jun 29 12:34:36.887087 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 93/209] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:36 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1554 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:36.914574 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1b5fde57-8bdf-4a99-9e69-ed3195370b0c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:36.921020 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-1b5fde57-8bdf-4a99-9e69-ed3195370b0c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:36.929565 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1b5fde57-8bdf-4a99-9e69-ed3195370b0c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:36.930359 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1b5fde57-8bdf-4a99-9e69-ed3195370b0c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:36.931364 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1b5fde57-8bdf-4a99-9e69-ed3195370b0c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:36.931993 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1b5fde57-8bdf-4a99-9e69-ed3195370b0c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:37.106615 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-1b5fde57-8bdf-4a99-9e69-ed3195370b0c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:37.116613 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-1b5fde57-8bdf-4a99-9e69-ed3195370b0c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.212405 Jun 29 12:34:37.117374 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 94/210] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:36 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:37.312882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-c2cf1af1-1b6f-41af-ab7d-82b7298e27cb tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Flavor limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 12:34:37.313466 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-c2cf1af1-1b6f-41af-ab7d-82b7298e27cb tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Image limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 12:34:37.314207 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-c2cf1af1-1b6f-41af-ab7d-82b7298e27cb tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Flavor pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 12:34:37.315430 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-c2cf1af1-1b6f-41af-ab7d-82b7298e27cb tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Image pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 12:34:37.315957 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-c2cf1af1-1b6f-41af-ab7d-82b7298e27cb tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 12:34:37.327292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c2cf1af1-1b6f-41af-ab7d-82b7298e27cb tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:37.327723 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c2cf1af1-1b6f-41af-ab7d-82b7298e27cb tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:37.328530 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c2cf1af1-1b6f-41af-ab7d-82b7298e27cb tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:37.329118 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c2cf1af1-1b6f-41af-ab7d-82b7298e27cb tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:37.336709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:34:37.368709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-c2cf1af1-1b6f-41af-ab7d-82b7298e27cb tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Getting quotas for project ed93385ff03f4672acc79e103ffcb82e. Resources: {'cores', 'ram', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:34:37.373640 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-c2cf1af1-1b6f-41af-ab7d-82b7298e27cb tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Getting quotas for user bba6a17fc19645c29fce6fa655095a0a and project ed93385ff03f4672acc79e103ffcb82e. Resources: {'cores', 'ram', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:34:37.388764 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c2cf1af1-1b6f-41af-ab7d-82b7298e27cb tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Going to run 1 instances... {{(pid=124317) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 12:34:37.391305 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c2cf1af1-1b6f-41af-ab7d-82b7298e27cb tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: 6f456ca2-df7a-46af-bb96-7226ec9ccf70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70887696-f652-46b0-a5be-bfb400986078',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124317) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 12:34:37.442688 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c2cf1af1-1b6f-41af-ab7d-82b7298e27cb tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.748878 Jun 29 12:34:37.448450 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 117/211] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 12:34:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 12:34:37.456850 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2caa0df6-378c-4b60-8728-dfb149bede5f tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:37.457654 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2caa0df6-378c-4b60-8728-dfb149bede5f tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: 6f456ca2-df7a-46af-bb96-7226ec9ccf70] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:37.529623 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2caa0df6-378c-4b60-8728-dfb149bede5f tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:37.539189 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2caa0df6-378c-4b60-8728-dfb149bede5f tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70" status: 200 len: 1213 microversion: 2.1 time: 0.087124 Jun 29 12:34:37.540198 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 95/212] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:37 2022] GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:37.907664 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d85decd6-d54e-49ea-a02b-c7332fd9b6b1 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:37.908448 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d85decd6-d54e-49ea-a02b-c7332fd9b6b1 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:37.911495 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:34:37.915974 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d85decd6-d54e-49ea-a02b-c7332fd9b6b1 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:37.916451 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d85decd6-d54e-49ea-a02b-c7332fd9b6b1 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:37.918655 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d85decd6-d54e-49ea-a02b-c7332fd9b6b1 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:37.918655 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d85decd6-d54e-49ea-a02b-c7332fd9b6b1 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:38.136220 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d85decd6-d54e-49ea-a02b-c7332fd9b6b1 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:38.138235 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b015229a-f561-4435-bc20-f597719f1ecc tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:38.139455 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b015229a-f561-4435-bc20-f597719f1ecc tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:38.147470 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b015229a-f561-4435-bc20-f597719f1ecc tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:38.148290 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b015229a-f561-4435-bc20-f597719f1ecc tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:38.149319 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b015229a-f561-4435-bc20-f597719f1ecc tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:38.150009 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b015229a-f561-4435-bc20-f597719f1ecc tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:38.152201 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d85decd6-d54e-49ea-a02b-c7332fd9b6b1 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1554 microversion: 2.1 time: 0.249272 Jun 29 12:34:38.153992 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 118/213] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:37 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1554 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:38.347684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b015229a-f561-4435-bc20-f597719f1ecc tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:38.367356 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b015229a-f561-4435-bc20-f597719f1ecc tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.234697 Jun 29 12:34:38.368301 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 96/214] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:38 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:38.560013 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-848e8ee6-4e36-4671-990f-be60513bb087 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:38.560630 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-848e8ee6-4e36-4671-990f-be60513bb087 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: 6f456ca2-df7a-46af-bb96-7226ec9ccf70] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:38.567199 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-848e8ee6-4e36-4671-990f-be60513bb087 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:38.567767 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-848e8ee6-4e36-4671-990f-be60513bb087 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:38.568687 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-848e8ee6-4e36-4671-990f-be60513bb087 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:38.569307 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-848e8ee6-4e36-4671-990f-be60513bb087 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:38.663401 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-848e8ee6-4e36-4671-990f-be60513bb087 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:38.672269 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-848e8ee6-4e36-4671-990f-be60513bb087 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70" status: 200 len: 1217 microversion: 2.1 time: 0.116301 Jun 29 12:34:38.672856 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 119/215] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:38 2022] GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70 => generated 1217 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:39.171882 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3aa8118d-5653-4cb4-a24a-6dba62a19850 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:39.172483 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3aa8118d-5653-4cb4-a24a-6dba62a19850 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:39.180487 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3aa8118d-5653-4cb4-a24a-6dba62a19850 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:39.180936 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3aa8118d-5653-4cb4-a24a-6dba62a19850 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:39.181695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3aa8118d-5653-4cb4-a24a-6dba62a19850 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:39.182152 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3aa8118d-5653-4cb4-a24a-6dba62a19850 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:39.358739 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3aa8118d-5653-4cb4-a24a-6dba62a19850 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:39.369213 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3aa8118d-5653-4cb4-a24a-6dba62a19850 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1554 microversion: 2.1 time: 0.201355 Jun 29 12:34:39.369786 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 97/216] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:39 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1554 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:39.384936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-43de2c5f-e57d-4708-99b2-72ec54519563 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:39.385642 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-43de2c5f-e57d-4708-99b2-72ec54519563 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:39.391692 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-43de2c5f-e57d-4708-99b2-72ec54519563 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:39.392230 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-43de2c5f-e57d-4708-99b2-72ec54519563 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:39.393063 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-43de2c5f-e57d-4708-99b2-72ec54519563 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:39.393528 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-43de2c5f-e57d-4708-99b2-72ec54519563 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:39.582247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-43de2c5f-e57d-4708-99b2-72ec54519563 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:39.590129 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-43de2c5f-e57d-4708-99b2-72ec54519563 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.208962 Jun 29 12:34:39.591892 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 120/217] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:39 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:39.698989 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b2a4fd74-e205-48a1-a468-7caef6262cc8 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:39.702205 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b2a4fd74-e205-48a1-a468-7caef6262cc8 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: 6f456ca2-df7a-46af-bb96-7226ec9ccf70] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:39.719286 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b2a4fd74-e205-48a1-a468-7caef6262cc8 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:39.719722 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b2a4fd74-e205-48a1-a468-7caef6262cc8 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:39.722134 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b2a4fd74-e205-48a1-a468-7caef6262cc8 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:39.722650 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b2a4fd74-e205-48a1-a468-7caef6262cc8 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:39.728551 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=100 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:34:39.867347 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b2a4fd74-e205-48a1-a468-7caef6262cc8 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:39.877153 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b2a4fd74-e205-48a1-a468-7caef6262cc8 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70" status: 200 len: 1283 microversion: 2.1 time: 0.190730 Jun 29 12:34:39.886484 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 98/218] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:39 2022] GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70 => generated 1283 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:40.387330 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5979548e-3439-41b4-a5a9-c21b47a8bc37 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:40.387946 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5979548e-3439-41b4-a5a9-c21b47a8bc37 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:40.400230 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5979548e-3439-41b4-a5a9-c21b47a8bc37 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:40.400690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5979548e-3439-41b4-a5a9-c21b47a8bc37 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:40.401647 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5979548e-3439-41b4-a5a9-c21b47a8bc37 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:40.402108 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5979548e-3439-41b4-a5a9-c21b47a8bc37 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:40.579409 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5979548e-3439-41b4-a5a9-c21b47a8bc37 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:40.593588 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5979548e-3439-41b4-a5a9-c21b47a8bc37 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1554 microversion: 2.1 time: 0.209759 Jun 29 12:34:40.595050 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 121/219] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:40 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1554 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:40.607895 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8d2688ef-b4bf-4663-8df4-0fcdf59ac0ee tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:40.608492 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8d2688ef-b4bf-4663-8df4-0fcdf59ac0ee tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:40.616048 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8d2688ef-b4bf-4663-8df4-0fcdf59ac0ee tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:40.616500 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8d2688ef-b4bf-4663-8df4-0fcdf59ac0ee tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:40.617900 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8d2688ef-b4bf-4663-8df4-0fcdf59ac0ee tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:40.619043 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8d2688ef-b4bf-4663-8df4-0fcdf59ac0ee tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:40.898580 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8c8e31d3-896b-42cc-8722-8d4bb402abe4 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:40.899441 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8c8e31d3-896b-42cc-8722-8d4bb402abe4 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: 6f456ca2-df7a-46af-bb96-7226ec9ccf70] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:40.910854 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8c8e31d3-896b-42cc-8722-8d4bb402abe4 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:40.911856 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8c8e31d3-896b-42cc-8722-8d4bb402abe4 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:40.913357 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8c8e31d3-896b-42cc-8722-8d4bb402abe4 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:40.914580 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8d2688ef-b4bf-4663-8df4-0fcdf59ac0ee tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:40.914996 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8c8e31d3-896b-42cc-8722-8d4bb402abe4 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:40.933111 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8d2688ef-b4bf-4663-8df4-0fcdf59ac0ee tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.329670 Jun 29 12:34:40.942636 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 99/220] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:40 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:41.003331 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8c8e31d3-896b-42cc-8722-8d4bb402abe4 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:41.012039 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8c8e31d3-896b-42cc-8722-8d4bb402abe4 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70" status: 200 len: 1271 microversion: 2.1 time: 0.120787 Jun 29 12:34:41.013495 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 122/221] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:40 2022] GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70 => generated 1271 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:41.043428 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-b567db27-9562-4c5a-a63c-56ea47936187 req-db70333a-b667-4364-ac19-36767855d318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6ff7e6-212e-41a7-9c74-df2c4e3a2010", "name": "network-vif-deleted", "tag": "9c0824d3-f095-48c6-8750-a139a1ca3582"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:34:41.053561 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-b567db27-9562-4c5a-a63c-56ea47936187 req-db70333a-b667-4364-ac19-36767855d318 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:41.054009 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-b567db27-9562-4c5a-a63c-56ea47936187 req-db70333a-b667-4364-ac19-36767855d318 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:41.068204 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-b567db27-9562-4c5a-a63c-56ea47936187 req-db70333a-b667-4364-ac19-36767855d318 service nova] Creating event network-vif-deleted:9c0824d3-f095-48c6-8750-a139a1ca3582 for instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 on hv-cinder-81268 Jun 29 12:34:41.074360 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-b567db27-9562-4c5a-a63c-56ea47936187 req-db70333a-b667-4364-ac19-36767855d318 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034777 Jun 29 12:34:41.075983 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 100/222] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:34:41.615193 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e4873e40-62ca-487a-9006-51b4b5b24778 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:41.616831 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e4873e40-62ca-487a-9006-51b4b5b24778 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:41.625699 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e4873e40-62ca-487a-9006-51b4b5b24778 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:41.626599 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e4873e40-62ca-487a-9006-51b4b5b24778 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:41.627982 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e4873e40-62ca-487a-9006-51b4b5b24778 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:41.628666 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e4873e40-62ca-487a-9006-51b4b5b24778 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:41.664180 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e4873e40-62ca-487a-9006-51b4b5b24778 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:41.664976 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e4873e40-62ca-487a-9006-51b4b5b24778 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:41.665644 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-e4873e40-62ca-487a-9006-51b4b5b24778 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lazy-loading 'fault' on Instance uuid 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 12:34:41.734158 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e4873e40-62ca-487a-9006-51b4b5b24778 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a232c3292ec4a0abda3a8bc91c5a267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5397c062a4868a0282f7535f84f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:41.743302 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e4873e40-62ca-487a-9006-51b4b5b24778 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 200 len: 1350 microversion: 2.1 time: 0.134876 Jun 29 12:34:41.744316 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 123/223] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:41 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 1350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:41.950129 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-94f43224-0638-4226-afbb-0ad7fbafa4d8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:41.951513 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-94f43224-0638-4226-afbb-0ad7fbafa4d8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:41.958655 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-94f43224-0638-4226-afbb-0ad7fbafa4d8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:41.959427 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-94f43224-0638-4226-afbb-0ad7fbafa4d8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:41.960290 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-94f43224-0638-4226-afbb-0ad7fbafa4d8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:41.960794 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-94f43224-0638-4226-afbb-0ad7fbafa4d8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:42.031195 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-30862514-83f2-42b5-aa1a-5a06a9a13dea tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:42.031798 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-30862514-83f2-42b5-aa1a-5a06a9a13dea tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: 6f456ca2-df7a-46af-bb96-7226ec9ccf70] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:42.037962 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-30862514-83f2-42b5-aa1a-5a06a9a13dea tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:42.038400 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-30862514-83f2-42b5-aa1a-5a06a9a13dea tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:42.039196 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-30862514-83f2-42b5-aa1a-5a06a9a13dea tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:42.039622 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-30862514-83f2-42b5-aa1a-5a06a9a13dea tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:42.178823 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-30862514-83f2-42b5-aa1a-5a06a9a13dea tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:42.186606 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-30862514-83f2-42b5-aa1a-5a06a9a13dea tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70" status: 200 len: 1313 microversion: 2.1 time: 0.159182 Jun 29 12:34:42.187324 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 124/224] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:42 2022] GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:42.323056 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-94f43224-0638-4226-afbb-0ad7fbafa4d8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:42.331306 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-94f43224-0638-4226-afbb-0ad7fbafa4d8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.385689 Jun 29 12:34:42.340922 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 101/225] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:41 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:42.762266 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-76a2ca70-d4af-4bd3-bc70-a063be5b0b7d tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:42.763728 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-76a2ca70-d4af-4bd3-bc70-a063be5b0b7d tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:42.772506 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-76a2ca70-d4af-4bd3-bc70-a063be5b0b7d tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:42.773635 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-76a2ca70-d4af-4bd3-bc70-a063be5b0b7d tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:42.775090 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-76a2ca70-d4af-4bd3-bc70-a063be5b0b7d tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:42.776002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-76a2ca70-d4af-4bd3-bc70-a063be5b0b7d tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:42.793509 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-76a2ca70-d4af-4bd3-bc70-a063be5b0b7d tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] HTTP exception thrown: Instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 could not be found. Jun 29 12:34:42.799297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-76a2ca70-d4af-4bd3-bc70-a063be5b0b7d tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Request method failure captured: Jun 29 12:34:42.799297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 HTTP/1.1 Jun 29 12:34:42.799297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:34:42.799297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:34:42.799297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:34:42.799297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:34:42.799297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:34:42.799297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:34:42.799297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:34:42.799297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:34:42.799297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEaa_vGc4WYiMO7XqJyW7xqKlMdJicBKCfvK8IyQX8dC0Q-Rk8SOxcKNhT8JFSp7ly6wqMquHEvpnBuyHMTFl4oZ_ieu-2X3H7q7UMWZXjTmrakjMI8kvlHLKnzEkBWLmyEU4d4RqtXgHNiLxNeYeL0k57oeI-WV_d14TRRq96SDFSU Jun 29 12:34:42.799297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:34:42.799297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:34:42.799297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:34:42.799297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:34:42.799297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:34:42.799297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:34:42.799297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: 46f5397c062a4868a0282f7535f84f7a Jun 29 12:34:42.799297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-DeleteServersTestJSON-2019210138 Jun 29 12:34:42.799297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:34:42.799297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:34:42.800839 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_46f5397c062a4868a0282f7535f84f7a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/46f5397c062a4868a0282f7535f84f7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46f5397c062a4868a0282f7535f84f7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46f5397c062a4868a0282f7535f84f7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:34:42.800839 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-DeleteServersTestJSON-2019210138 Jun 29 12:34:42.800839 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 46f5397c062a4868a0282f7535f84f7a Jun 29 12:34:42.800839 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-DeleteServersTestJSON-2019210138 Jun 29 12:34:42.800839 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-DeleteServersTestJSON-2019210138-project Jun 29 12:34:42.800839 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:34:42.800839 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:34:42.800839 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: 8a232c3292ec4a0abda3a8bc91c5a267 Jun 29 12:34:42.800839 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-DeleteServersTestJSON-2019210138-project Jun 29 12:34:42.800839 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:34:42.800839 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 could not be found. Jun 29 12:34:42.800839 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': '4d6ff7e6-212e-41a7-9c74-df2c4e3a2010'} Jun 29 12:34:42.801589 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:34:42.801589 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:34:42.801589 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:34:42.801589 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:34:42.801589 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:34:42.801589 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:34:42.801589 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:34:42.801589 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:34:42.801589 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:34:42.801589 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:34:42.801589 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 could not be found. Jun 29 12:34:42.801589 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:34:42.801589 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:34:42.801589 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:34:42.801589 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:34:42.801589 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:34:42.801589 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:34:42.801589 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:34:42.801589 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:34:42.801589 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:34:42.802955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:34:42.802955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:34:42.802955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:34:42.802955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:34:42.802955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:34:42.802955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:34:42.802955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:34:42.802955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 could not be found. Jun 29 12:34:42.802955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:34:42.802955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:34:42.802955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:34:42.802955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:34:42.802955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:34:42.802955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:34:42.802955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:34:42.802955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:34:42.802955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 could not be found. Jun 29 12:34:42.802955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:34:42.804614 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-76a2ca70-d4af-4bd3-bc70-a063be5b0b7d tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Returning 404 to user: Instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:34:42.804614 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-76a2ca70-d4af-4bd3-bc70-a063be5b0b7d tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 404 len: 111 microversion: 2.1 time: 0.043663 Jun 29 12:34:42.805446 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 125/226] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:42 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:34:42.932728 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-13bbdd08-59d0-408e-9745-92de44c38e8a tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:42.934062 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-13bbdd08-59d0-408e-9745-92de44c38e8a tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:42.941783 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-13bbdd08-59d0-408e-9745-92de44c38e8a tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:42.942232 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-13bbdd08-59d0-408e-9745-92de44c38e8a tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:42.943038 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-13bbdd08-59d0-408e-9745-92de44c38e8a tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:42.943470 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-13bbdd08-59d0-408e-9745-92de44c38e8a tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:42.957490 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-13bbdd08-59d0-408e-9745-92de44c38e8a tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] HTTP exception thrown: Instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 could not be found. Jun 29 12:34:42.959608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-13bbdd08-59d0-408e-9745-92de44c38e8a tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Request method failure captured: Jun 29 12:34:42.959608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010/os-volume_attachments HTTP/1.1 Jun 29 12:34:42.959608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept: application/json Jun 29 12:34:42.959608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jun 29 12:34:42.959608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Connection: close Jun 29 12:34:42.959608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jun 29 12:34:42.959608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jun 29 12:34:42.959608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Host: 10.222.0.52 Jun 29 12:34:42.959608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jun 29 12:34:42.959608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jun 29 12:34:42.959608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivEaa_vGc4WYiMO7XqJyW7xqKlMdJicBKCfvK8IyQX8dC0Q-Rk8SOxcKNhT8JFSp7ly6wqMquHEvpnBuyHMTFl4oZ_ieu-2X3H7q7UMWZXjTmrakjMI8kvlHLKnzEkBWLmyEU4d4RqtXgHNiLxNeYeL0k57oeI-WV_d14TRRq96SDFSU Jun 29 12:34:42.959608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jun 29 12:34:42.959608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jun 29 12:34:42.959608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jun 29 12:34:42.959608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jun 29 12:34:42.959608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jun 29 12:34:42.959608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jun 29 12:34:42.959608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Id: 46f5397c062a4868a0282f7535f84f7a Jun 29 12:34:42.959608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-DeleteServersTestJSON-2019210138 Jun 29 12:34:42.959608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jun 29 12:34:42.959608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jun 29 12:34:42.960860 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_46f5397c062a4868a0282f7535f84f7a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/46f5397c062a4868a0282f7535f84f7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46f5397c062a4868a0282f7535f84f7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46f5397c062a4868a0282f7535f84f7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:34:42.960860 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-DeleteServersTestJSON-2019210138 Jun 29 12:34:42.960860 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Id: 46f5397c062a4868a0282f7535f84f7a Jun 29 12:34:42.960860 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-DeleteServersTestJSON-2019210138 Jun 29 12:34:42.960860 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User: tempest-DeleteServersTestJSON-2019210138-project Jun 29 12:34:42.960860 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jun 29 12:34:42.960860 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jun 29 12:34:42.960860 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Id: 8a232c3292ec4a0abda3a8bc91c5a267 Jun 29 12:34:42.960860 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-DeleteServersTestJSON-2019210138-project Jun 29 12:34:42.960860 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: method: > Jun 29 12:34:42.960860 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: exception: Instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 could not be found. Jun 29 12:34:42.960860 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: action_args: {'server_id': '4d6ff7e6-212e-41a7-9c74-df2c4e3a2010'} Jun 29 12:34:42.961533 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:34:42.961533 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:34:42.961533 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:34:42.961533 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:34:42.961533 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:34:42.961533 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:34:42.961533 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:34:42.961533 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:34:42.961533 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:34:42.961533 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:34:42.961533 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 could not be found. Jun 29 12:34:42.961533 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:34:42.961533 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:34:42.961533 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:34:42.961533 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:34:42.961533 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:34:42.961533 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:34:42.961533 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:34:42.961533 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:34:42.961533 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:34:42.964119 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:34:42.964119 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 29 12:34:42.964119 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 12:34:42.964119 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 29 12:34:42.964119 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 12:34:42.964119 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 29 12:34:42.964119 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 29 12:34:42.964119 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:34:42.964119 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:34:42.964119 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 could not be found. Jun 29 12:34:42.964119 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:34:42.964119 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:34:42.964119 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:34:42.964119 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:34:42.964119 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:34:42.964119 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:34:42.964119 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:34:42.964119 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:34:42.964119 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 could not be found. Jun 29 12:34:42.964119 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:34:42.965485 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-13bbdd08-59d0-408e-9745-92de44c38e8a tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Returning 404 to user: Instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:34:42.965485 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-13bbdd08-59d0-408e-9745-92de44c38e8a tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032617 Jun 29 12:34:42.965485 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 102/227] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 12:34:42 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:34:43.126450 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-4f087e1f-c969-4421-a80d-a5bf08509b18 req-16fe1060-00c2-4763-8aae-272c3d658dec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f456ca2-df7a-46af-bb96-7226ec9ccf70", "tag": "cee3ccfd-1b4c-4337-9108-8c4324eec706"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:34:43.136637 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-4f087e1f-c969-4421-a80d-a5bf08509b18 req-16fe1060-00c2-4763-8aae-272c3d658dec service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:43.137421 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-4f087e1f-c969-4421-a80d-a5bf08509b18 req-16fe1060-00c2-4763-8aae-272c3d658dec service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:43.150507 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-4f087e1f-c969-4421-a80d-a5bf08509b18 req-16fe1060-00c2-4763-8aae-272c3d658dec service nova] Creating event network-changed:cee3ccfd-1b4c-4337-9108-8c4324eec706 for instance 6f456ca2-df7a-46af-bb96-7226ec9ccf70 on hv-cinder-81268 Jun 29 12:34:43.165710 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-4f087e1f-c969-4421-a80d-a5bf08509b18 req-16fe1060-00c2-4763-8aae-272c3d658dec service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043499 Jun 29 12:34:43.166725 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 126/228] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:34:43.203984 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2df81bf8-a0e6-4fa1-9723-9a5af5e25f36 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:43.204759 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2df81bf8-a0e6-4fa1-9723-9a5af5e25f36 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: 6f456ca2-df7a-46af-bb96-7226ec9ccf70] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:43.211885 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2df81bf8-a0e6-4fa1-9723-9a5af5e25f36 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:43.212338 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2df81bf8-a0e6-4fa1-9723-9a5af5e25f36 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:43.213298 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2df81bf8-a0e6-4fa1-9723-9a5af5e25f36 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:43.213883 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2df81bf8-a0e6-4fa1-9723-9a5af5e25f36 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:43.350734 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-cfaa7122-d380-48c6-af71-3bca3f012102 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:43.351522 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-cfaa7122-d380-48c6-af71-3bca3f012102 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:43.357204 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2df81bf8-a0e6-4fa1-9723-9a5af5e25f36 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:43.358916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cfaa7122-d380-48c6-af71-3bca3f012102 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:43.359482 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cfaa7122-d380-48c6-af71-3bca3f012102 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:43.360451 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cfaa7122-d380-48c6-af71-3bca3f012102 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:43.361391 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cfaa7122-d380-48c6-af71-3bca3f012102 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:43.366019 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2df81bf8-a0e6-4fa1-9723-9a5af5e25f36 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70" status: 200 len: 1313 microversion: 2.1 time: 0.165607 Jun 29 12:34:43.366469 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 103/229] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:43 2022] GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:43.538987 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-cfaa7122-d380-48c6-af71-3bca3f012102 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:43.547567 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-cfaa7122-d380-48c6-af71-3bca3f012102 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.202499 Jun 29 12:34:43.554489 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 127/230] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:43 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:44.172877 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5e739a1a-10df-447c-9050-e159d0f1e9ad tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:44.173365 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5e739a1a-10df-447c-9050-e159d0f1e9ad tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:44.179970 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5e739a1a-10df-447c-9050-e159d0f1e9ad tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:44.180421 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5e739a1a-10df-447c-9050-e159d0f1e9ad tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:44.181211 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5e739a1a-10df-447c-9050-e159d0f1e9ad tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:44.181652 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5e739a1a-10df-447c-9050-e159d0f1e9ad tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:44.208048 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-5e739a1a-10df-447c-9050-e159d0f1e9ad tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] HTTP exception thrown: Instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 could not be found. Jun 29 12:34:44.209639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5e739a1a-10df-447c-9050-e159d0f1e9ad tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Request method failure captured: Jun 29 12:34:44.209639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: request: DELETE /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 HTTP/1.1 Jun 29 12:34:44.209639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept: application/json Jun 29 12:34:44.209639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jun 29 12:34:44.209639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Connection: close Jun 29 12:34:44.209639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jun 29 12:34:44.209639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jun 29 12:34:44.209639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Host: 10.222.0.52 Jun 29 12:34:44.209639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jun 29 12:34:44.209639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jun 29 12:34:44.209639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivEaa_vGc4WYiMO7XqJyW7xqKlMdJicBKCfvK8IyQX8dC0Q-Rk8SOxcKNhT8JFSp7ly6wqMquHEvpnBuyHMTFl4oZ_ieu-2X3H7q7UMWZXjTmrakjMI8kvlHLKnzEkBWLmyEU4d4RqtXgHNiLxNeYeL0k57oeI-WV_d14TRRq96SDFSU Jun 29 12:34:44.209639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jun 29 12:34:44.209639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jun 29 12:34:44.209639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jun 29 12:34:44.209639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jun 29 12:34:44.209639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jun 29 12:34:44.209639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jun 29 12:34:44.209639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Id: 46f5397c062a4868a0282f7535f84f7a Jun 29 12:34:44.209639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-DeleteServersTestJSON-2019210138 Jun 29 12:34:44.209639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jun 29 12:34:44.209639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jun 29 12:34:44.211367 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_46f5397c062a4868a0282f7535f84f7a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/46f5397c062a4868a0282f7535f84f7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46f5397c062a4868a0282f7535f84f7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46f5397c062a4868a0282f7535f84f7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:34:44.211367 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-DeleteServersTestJSON-2019210138 Jun 29 12:34:44.211367 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Id: 46f5397c062a4868a0282f7535f84f7a Jun 29 12:34:44.211367 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-DeleteServersTestJSON-2019210138 Jun 29 12:34:44.211367 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User: tempest-DeleteServersTestJSON-2019210138-project Jun 29 12:34:44.211367 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jun 29 12:34:44.211367 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jun 29 12:34:44.211367 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Id: 8a232c3292ec4a0abda3a8bc91c5a267 Jun 29 12:34:44.211367 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-DeleteServersTestJSON-2019210138-project Jun 29 12:34:44.211367 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: method: > Jun 29 12:34:44.211367 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: exception: Instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 could not be found. Jun 29 12:34:44.211367 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: action_args: {'id': '4d6ff7e6-212e-41a7-9c74-df2c4e3a2010'} Jun 29 12:34:44.212148 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:34:44.212148 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:34:44.212148 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:34:44.212148 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:34:44.212148 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:34:44.212148 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:34:44.212148 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:34:44.212148 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:34:44.212148 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:34:44.212148 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:34:44.212148 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 could not be found. Jun 29 12:34:44.212148 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:34:44.212148 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:34:44.212148 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:34:44.212148 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:34:44.212148 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:34:44.212148 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:34:44.212148 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:34:44.212148 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:34:44.212148 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:34:44.213323 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:34:44.213323 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 12:34:44.213323 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 12:34:44.213323 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 12:34:44.213323 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 12:34:44.213323 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:34:44.213323 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:34:44.213323 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:34:44.213323 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:34:44.213323 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 could not be found. Jun 29 12:34:44.213323 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:34:44.213323 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:34:44.213323 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:34:44.213323 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:34:44.213323 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:34:44.213323 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:34:44.213323 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:34:44.213323 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:34:44.213323 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 could not be found. Jun 29 12:34:44.213323 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:34:44.214647 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5e739a1a-10df-447c-9050-e159d0f1e9ad tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Returning 404 to user: Instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:34:44.214647 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5e739a1a-10df-447c-9050-e159d0f1e9ad tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 404 len: 111 microversion: 2.1 time: 0.042246 Jun 29 12:34:44.214647 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 104/231] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:34:44 2022] DELETE /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:34:44.221178 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a78f1977-aee6-473b-a7ba-569b2aef17a6 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:44.230457 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a78f1977-aee6-473b-a7ba-569b2aef17a6 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] [instance: 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:44.238658 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a78f1977-aee6-473b-a7ba-569b2aef17a6 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:44.239107 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a78f1977-aee6-473b-a7ba-569b2aef17a6 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:44.239880 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a78f1977-aee6-473b-a7ba-569b2aef17a6 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:44.240319 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a78f1977-aee6-473b-a7ba-569b2aef17a6 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:44.254707 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-a78f1977-aee6-473b-a7ba-569b2aef17a6 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] HTTP exception thrown: Instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 could not be found. Jun 29 12:34:44.256377 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a78f1977-aee6-473b-a7ba-569b2aef17a6 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Request method failure captured: Jun 29 12:34:44.256377 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 HTTP/1.1 Jun 29 12:34:44.256377 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:34:44.256377 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:34:44.256377 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:34:44.256377 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:34:44.256377 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:34:44.256377 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:34:44.256377 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:34:44.256377 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:34:44.256377 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEaa_vGc4WYiMO7XqJyW7xqKlMdJicBKCfvK8IyQX8dC0Q-Rk8SOxcKNhT8JFSp7ly6wqMquHEvpnBuyHMTFl4oZ_ieu-2X3H7q7UMWZXjTmrakjMI8kvlHLKnzEkBWLmyEU4d4RqtXgHNiLxNeYeL0k57oeI-WV_d14TRRq96SDFSU Jun 29 12:34:44.256377 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:34:44.256377 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:34:44.256377 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:34:44.256377 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:34:44.256377 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:34:44.256377 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:34:44.256377 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: 46f5397c062a4868a0282f7535f84f7a Jun 29 12:34:44.256377 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-DeleteServersTestJSON-2019210138 Jun 29 12:34:44.256377 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:34:44.256377 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:34:44.257651 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_46f5397c062a4868a0282f7535f84f7a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/46f5397c062a4868a0282f7535f84f7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46f5397c062a4868a0282f7535f84f7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/46f5397c062a4868a0282f7535f84f7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:34:44.257651 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-DeleteServersTestJSON-2019210138 Jun 29 12:34:44.257651 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 46f5397c062a4868a0282f7535f84f7a Jun 29 12:34:44.257651 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-DeleteServersTestJSON-2019210138 Jun 29 12:34:44.257651 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-DeleteServersTestJSON-2019210138-project Jun 29 12:34:44.257651 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:34:44.257651 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:34:44.257651 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: 8a232c3292ec4a0abda3a8bc91c5a267 Jun 29 12:34:44.257651 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-DeleteServersTestJSON-2019210138-project Jun 29 12:34:44.257651 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:34:44.257651 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 could not be found. Jun 29 12:34:44.257651 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': '4d6ff7e6-212e-41a7-9c74-df2c4e3a2010'} Jun 29 12:34:44.258309 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:34:44.258309 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:34:44.258309 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:34:44.258309 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:34:44.258309 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:34:44.258309 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:34:44.258309 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:34:44.258309 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:34:44.258309 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:34:44.258309 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:34:44.258309 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 could not be found. Jun 29 12:34:44.258309 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:34:44.258309 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:34:44.258309 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:34:44.258309 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:34:44.258309 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:34:44.258309 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:34:44.258309 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:34:44.258309 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:34:44.258309 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:34:44.259391 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:34:44.259391 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:34:44.259391 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:34:44.259391 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:34:44.259391 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:34:44.259391 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:34:44.259391 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:34:44.259391 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 could not be found. Jun 29 12:34:44.259391 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:34:44.259391 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:34:44.259391 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:34:44.259391 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:34:44.259391 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:34:44.259391 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:34:44.259391 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:34:44.259391 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:34:44.259391 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 could not be found. Jun 29 12:34:44.259391 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:34:44.260440 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a78f1977-aee6-473b-a7ba-569b2aef17a6 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] Returning 404 to user: Instance 4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:34:44.260440 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a78f1977-aee6-473b-a7ba-569b2aef17a6 tempest-DeleteServersTestJSON-2019210138 tempest-DeleteServersTestJSON-2019210138-project] 10.222.0.52 "GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010" status: 404 len: 111 microversion: 2.1 time: 0.041904 Jun 29 12:34:44.260440 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 128/232] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:44 2022] GET /compute/v2.1/servers/4d6ff7e6-212e-41a7-9c74-df2c4e3a2010 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:34:44.385349 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4853eced-d15c-434c-8c56-ccb589bfedc0 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:44.386356 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4853eced-d15c-434c-8c56-ccb589bfedc0 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: 6f456ca2-df7a-46af-bb96-7226ec9ccf70] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:44.394370 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4853eced-d15c-434c-8c56-ccb589bfedc0 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:44.394987 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4853eced-d15c-434c-8c56-ccb589bfedc0 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:44.396183 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4853eced-d15c-434c-8c56-ccb589bfedc0 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:44.396913 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4853eced-d15c-434c-8c56-ccb589bfedc0 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:44.567830 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4c4bf1c4-871b-450f-974c-8b87a6c8b846 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:44.569012 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4c4bf1c4-871b-450f-974c-8b87a6c8b846 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:44.576153 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4c4bf1c4-871b-450f-974c-8b87a6c8b846 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:44.577321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4c4bf1c4-871b-450f-974c-8b87a6c8b846 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:44.578302 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4c4bf1c4-871b-450f-974c-8b87a6c8b846 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:44.579226 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4c4bf1c4-871b-450f-974c-8b87a6c8b846 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:44.739085 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4853eced-d15c-434c-8c56-ccb589bfedc0 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:44.758218 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4853eced-d15c-434c-8c56-ccb589bfedc0 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70" status: 200 len: 1313 microversion: 2.1 time: 0.377248 Jun 29 12:34:44.759343 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 105/233] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:44 2022] GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70 => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:44.910764 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4c4bf1c4-871b-450f-974c-8b87a6c8b846 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:44.919376 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4c4bf1c4-871b-450f-974c-8b87a6c8b846 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.357074 Jun 29 12:34:44.920787 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 129/234] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:44 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:45.786783 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0e3841dc-2dbe-41a3-be42-7582d8b89277 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:45.787414 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0e3841dc-2dbe-41a3-be42-7582d8b89277 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: 6f456ca2-df7a-46af-bb96-7226ec9ccf70] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:45.796092 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0e3841dc-2dbe-41a3-be42-7582d8b89277 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:45.796544 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0e3841dc-2dbe-41a3-be42-7582d8b89277 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:45.797355 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0e3841dc-2dbe-41a3-be42-7582d8b89277 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:45.797788 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0e3841dc-2dbe-41a3-be42-7582d8b89277 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:45.938734 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d6cae695-dfdd-484d-89ab-1628b09cc525 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:45.939643 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d6cae695-dfdd-484d-89ab-1628b09cc525 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:45.963995 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d6cae695-dfdd-484d-89ab-1628b09cc525 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:45.967028 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d6cae695-dfdd-484d-89ab-1628b09cc525 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:45.967871 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d6cae695-dfdd-484d-89ab-1628b09cc525 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:45.968317 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d6cae695-dfdd-484d-89ab-1628b09cc525 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:46.176825 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0e3841dc-2dbe-41a3-be42-7582d8b89277 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:46.187720 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0e3841dc-2dbe-41a3-be42-7582d8b89277 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70" status: 200 len: 1313 microversion: 2.1 time: 0.411611 Jun 29 12:34:46.199142 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 106/235] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:45 2022] GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70 => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:46.318939 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d6cae695-dfdd-484d-89ab-1628b09cc525 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:46.328803 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d6cae695-dfdd-484d-89ab-1628b09cc525 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.394697 Jun 29 12:34:46.330529 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 130/236] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:45 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:47.204978 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-39fc725f-cad3-48da-8e4d-ba14f8bfd922 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:47.205721 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-39fc725f-cad3-48da-8e4d-ba14f8bfd922 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: 6f456ca2-df7a-46af-bb96-7226ec9ccf70] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:47.213515 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-39fc725f-cad3-48da-8e4d-ba14f8bfd922 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:47.213970 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-39fc725f-cad3-48da-8e4d-ba14f8bfd922 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:47.215032 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-39fc725f-cad3-48da-8e4d-ba14f8bfd922 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:47.215500 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-39fc725f-cad3-48da-8e4d-ba14f8bfd922 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:47.347810 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:34:47.355001 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b89d9f10-a0da-4cce-9889-029e5703b277 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:47.355911 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b89d9f10-a0da-4cce-9889-029e5703b277 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:47.369960 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b89d9f10-a0da-4cce-9889-029e5703b277 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:47.370411 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b89d9f10-a0da-4cce-9889-029e5703b277 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:47.371213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b89d9f10-a0da-4cce-9889-029e5703b277 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:47.371647 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b89d9f10-a0da-4cce-9889-029e5703b277 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:47.388610 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=6 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:34:47.535917 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:34:47.576935 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-39fc725f-cad3-48da-8e4d-ba14f8bfd922 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:47.595100 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-39fc725f-cad3-48da-8e4d-ba14f8bfd922 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70" status: 200 len: 1313 microversion: 2.1 time: 0.393248 Jun 29 12:34:47.606299 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 107/237] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:47 2022] GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70 => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:47.680914 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b89d9f10-a0da-4cce-9889-029e5703b277 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:47.688820 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b89d9f10-a0da-4cce-9889-029e5703b277 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.345552 Jun 29 12:34:47.689542 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 131/238] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:47 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:48.616224 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d639139e-fee9-4633-bc58-d74ab17db22a tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:48.616919 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d639139e-fee9-4633-bc58-d74ab17db22a tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: 6f456ca2-df7a-46af-bb96-7226ec9ccf70] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:48.626340 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d639139e-fee9-4633-bc58-d74ab17db22a tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:48.627817 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d639139e-fee9-4633-bc58-d74ab17db22a tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:48.629711 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d639139e-fee9-4633-bc58-d74ab17db22a tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:48.631983 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d639139e-fee9-4633-bc58-d74ab17db22a tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:48.705686 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-aed1d5bc-5207-4f27-b282-62ed276acc9a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:48.706870 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-aed1d5bc-5207-4f27-b282-62ed276acc9a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:48.714765 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aed1d5bc-5207-4f27-b282-62ed276acc9a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:48.721559 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aed1d5bc-5207-4f27-b282-62ed276acc9a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:48.722614 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aed1d5bc-5207-4f27-b282-62ed276acc9a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:48.723215 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aed1d5bc-5207-4f27-b282-62ed276acc9a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:48.927543 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d639139e-fee9-4633-bc58-d74ab17db22a tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:48.941411 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d639139e-fee9-4633-bc58-d74ab17db22a tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70" status: 200 len: 1313 microversion: 2.1 time: 0.329731 Jun 29 12:34:48.943419 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 108/239] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:48 2022] GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70 => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:49.148293 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-aed1d5bc-5207-4f27-b282-62ed276acc9a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:49.165910 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-aed1d5bc-5207-4f27-b282-62ed276acc9a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.462871 Jun 29 12:34:49.169547 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 132/240] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:48 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:49.435715 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-bd683c4b-0446-4590-816e-2cc645ca9693 req-bb59605e-77eb-4c39-b5e0-3bfe7ef1c388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f456ca2-df7a-46af-bb96-7226ec9ccf70", "name": "network-vif-plugged", "status": "completed", "tag": "cee3ccfd-1b4c-4337-9108-8c4324eec706"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:34:49.464266 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=73 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:34:49.468028 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-bd683c4b-0446-4590-816e-2cc645ca9693 req-bb59605e-77eb-4c39-b5e0-3bfe7ef1c388 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:49.468570 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-bd683c4b-0446-4590-816e-2cc645ca9693 req-bb59605e-77eb-4c39-b5e0-3bfe7ef1c388 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:49.484709 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-bd683c4b-0446-4590-816e-2cc645ca9693 req-bb59605e-77eb-4c39-b5e0-3bfe7ef1c388 service nova] Creating event network-vif-plugged:cee3ccfd-1b4c-4337-9108-8c4324eec706 for instance 6f456ca2-df7a-46af-bb96-7226ec9ccf70 on hv-cinder-81268 Jun 29 12:34:49.490648 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-bd683c4b-0446-4590-816e-2cc645ca9693 req-bb59605e-77eb-4c39-b5e0-3bfe7ef1c388 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059222 Jun 29 12:34:49.491667 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 109/241] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:34:49.963000 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9b4cc578-198a-4bf5-943b-1ecf16f87f07 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:49.963689 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-9b4cc578-198a-4bf5-943b-1ecf16f87f07 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: 6f456ca2-df7a-46af-bb96-7226ec9ccf70] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:49.973417 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9b4cc578-198a-4bf5-943b-1ecf16f87f07 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:49.974145 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9b4cc578-198a-4bf5-943b-1ecf16f87f07 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:49.975019 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9b4cc578-198a-4bf5-943b-1ecf16f87f07 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:49.975615 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9b4cc578-198a-4bf5-943b-1ecf16f87f07 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:50.186905 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-de27d98d-f11f-4f27-a5de-9b0b75a77063 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:50.199682 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-de27d98d-f11f-4f27-a5de-9b0b75a77063 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:50.207515 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-9b4cc578-198a-4bf5-943b-1ecf16f87f07 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:50.218791 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-de27d98d-f11f-4f27-a5de-9b0b75a77063 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:50.219471 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-de27d98d-f11f-4f27-a5de-9b0b75a77063 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:50.222482 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-de27d98d-f11f-4f27-a5de-9b0b75a77063 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:50.222722 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-de27d98d-f11f-4f27-a5de-9b0b75a77063 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:50.231701 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-9b4cc578-198a-4bf5-943b-1ecf16f87f07 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70" status: 200 len: 1313 microversion: 2.1 time: 0.274487 Jun 29 12:34:50.232645 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 133/242] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:49 2022] GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:50.419344 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-de27d98d-f11f-4f27-a5de-9b0b75a77063 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:50.429139 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-de27d98d-f11f-4f27-a5de-9b0b75a77063 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.246967 Jun 29 12:34:50.440762 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 110/243] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:50 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:51.251025 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3e1b0924-86d8-45c6-82cc-ba164923181c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:51.253628 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3e1b0924-86d8-45c6-82cc-ba164923181c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: 6f456ca2-df7a-46af-bb96-7226ec9ccf70] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:51.262165 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3e1b0924-86d8-45c6-82cc-ba164923181c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:51.262792 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3e1b0924-86d8-45c6-82cc-ba164923181c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:51.263880 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3e1b0924-86d8-45c6-82cc-ba164923181c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:51.264825 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3e1b0924-86d8-45c6-82cc-ba164923181c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:51.449393 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3e1b0924-86d8-45c6-82cc-ba164923181c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:51.457475 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f75114e4-8e9c-403b-acd7-e3fcb5957a31 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:51.459315 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f75114e4-8e9c-403b-acd7-e3fcb5957a31 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:51.461964 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3e1b0924-86d8-45c6-82cc-ba164923181c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70" status: 200 len: 1313 microversion: 2.1 time: 0.216554 Jun 29 12:34:51.462690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 134/244] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:51 2022] GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:51.467968 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f75114e4-8e9c-403b-acd7-e3fcb5957a31 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:51.468456 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f75114e4-8e9c-403b-acd7-e3fcb5957a31 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:51.469296 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f75114e4-8e9c-403b-acd7-e3fcb5957a31 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:51.469738 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f75114e4-8e9c-403b-acd7-e3fcb5957a31 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:51.635412 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f75114e4-8e9c-403b-acd7-e3fcb5957a31 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:51.647510 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f75114e4-8e9c-403b-acd7-e3fcb5957a31 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.203338 Jun 29 12:34:51.648498 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 111/245] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:51 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:52.480473 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-aeaf3455-a972-496e-b3ef-ceeeb90a5643 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:52.482188 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-aeaf3455-a972-496e-b3ef-ceeeb90a5643 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: 6f456ca2-df7a-46af-bb96-7226ec9ccf70] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:52.490927 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aeaf3455-a972-496e-b3ef-ceeeb90a5643 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:52.491944 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aeaf3455-a972-496e-b3ef-ceeeb90a5643 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:52.493181 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aeaf3455-a972-496e-b3ef-ceeeb90a5643 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:52.493834 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aeaf3455-a972-496e-b3ef-ceeeb90a5643 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:52.665736 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1cf6c694-8c10-4e45-8cd7-1e07b503a511 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:52.667231 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-1cf6c694-8c10-4e45-8cd7-1e07b503a511 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:52.679213 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1cf6c694-8c10-4e45-8cd7-1e07b503a511 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:52.681841 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1cf6c694-8c10-4e45-8cd7-1e07b503a511 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:52.685835 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1cf6c694-8c10-4e45-8cd7-1e07b503a511 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:52.687414 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1cf6c694-8c10-4e45-8cd7-1e07b503a511 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:52.767726 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-aeaf3455-a972-496e-b3ef-ceeeb90a5643 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:52.778513 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-aeaf3455-a972-496e-b3ef-ceeeb90a5643 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70" status: 200 len: 1313 microversion: 2.1 time: 0.302660 Jun 29 12:34:52.779577 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 135/246] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:52 2022] GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:52.927268 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-1cf6c694-8c10-4e45-8cd7-1e07b503a511 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:52.937056 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-1cf6c694-8c10-4e45-8cd7-1e07b503a511 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.275862 Jun 29 12:34:52.938093 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 112/247] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:52 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:53.797227 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-47a96cd6-921a-4273-8b82-2064b4f3035d tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:53.798116 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-47a96cd6-921a-4273-8b82-2064b4f3035d tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: 6f456ca2-df7a-46af-bb96-7226ec9ccf70] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:53.805097 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-47a96cd6-921a-4273-8b82-2064b4f3035d tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:53.805764 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-47a96cd6-921a-4273-8b82-2064b4f3035d tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:53.806558 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-47a96cd6-921a-4273-8b82-2064b4f3035d tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:53.806985 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-47a96cd6-921a-4273-8b82-2064b4f3035d tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:53.811155 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=100 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:34:53.955660 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-87bef7ad-cd55-4dfb-bdf3-aac6c3472a3f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:53.956275 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-87bef7ad-cd55-4dfb-bdf3-aac6c3472a3f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:53.964187 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-87bef7ad-cd55-4dfb-bdf3-aac6c3472a3f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:53.964863 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-87bef7ad-cd55-4dfb-bdf3-aac6c3472a3f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:53.965406 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-87bef7ad-cd55-4dfb-bdf3-aac6c3472a3f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:53.966010 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-87bef7ad-cd55-4dfb-bdf3-aac6c3472a3f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:53.989188 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-47a96cd6-921a-4273-8b82-2064b4f3035d tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:53.997615 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-47a96cd6-921a-4273-8b82-2064b4f3035d tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70" status: 200 len: 1496 microversion: 2.1 time: 0.204439 Jun 29 12:34:53.999109 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 136/248] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:53 2022] GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70 => generated 1496 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:54.129907 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-87bef7ad-cd55-4dfb-bdf3-aac6c3472a3f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:54.143052 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-87bef7ad-cd55-4dfb-bdf3-aac6c3472a3f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.190455 Jun 29 12:34:54.144817 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 113/249] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:53 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:55.162213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-91181338-14e4-4892-b454-360a282cb42c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:55.163020 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-91181338-14e4-4892-b454-360a282cb42c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:55.171405 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-91181338-14e4-4892-b454-360a282cb42c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:55.171784 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-91181338-14e4-4892-b454-360a282cb42c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:55.172549 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-91181338-14e4-4892-b454-360a282cb42c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:55.173079 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-91181338-14e4-4892-b454-360a282cb42c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:55.311003 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-91181338-14e4-4892-b454-360a282cb42c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:55.319251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-91181338-14e4-4892-b454-360a282cb42c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.161379 Jun 29 12:34:55.319902 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 137/250] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:55 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:56.340825 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4296bc98-6f59-4050-90bc-6a550ee341a0 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:56.341814 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4296bc98-6f59-4050-90bc-6a550ee341a0 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:56.348960 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4296bc98-6f59-4050-90bc-6a550ee341a0 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:56.350131 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4296bc98-6f59-4050-90bc-6a550ee341a0 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:56.351205 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4296bc98-6f59-4050-90bc-6a550ee341a0 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:56.352300 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4296bc98-6f59-4050-90bc-6a550ee341a0 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:56.656985 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b19d6404-c7e5-4c84-bdca-570fa15fd8ae tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:56.659738 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b19d6404-c7e5-4c84-bdca-570fa15fd8ae tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: 6f456ca2-df7a-46af-bb96-7226ec9ccf70] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:56.675641 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b19d6404-c7e5-4c84-bdca-570fa15fd8ae tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:56.676433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b19d6404-c7e5-4c84-bdca-570fa15fd8ae tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:56.678004 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b19d6404-c7e5-4c84-bdca-570fa15fd8ae tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:56.678953 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b19d6404-c7e5-4c84-bdca-570fa15fd8ae tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:56.710982 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b19d6404-c7e5-4c84-bdca-570fa15fd8ae tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: 6f456ca2-df7a-46af-bb96-7226ec9ccf70] Going to try to terminate instance {{(pid=124317) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 12:34:56.793165 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4296bc98-6f59-4050-90bc-6a550ee341a0 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:56.810781 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b19d6404-c7e5-4c84-bdca-570fa15fd8ae tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70" status: 204 len: 0 microversion: 2.1 time: 0.159395 Jun 29 12:34:56.811442 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 138/251] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:34:56 2022] DELETE /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 12:34:56.822190 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6d483e80-7705-48f0-a26e-8f658ca1c46c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:56.823073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-6d483e80-7705-48f0-a26e-8f658ca1c46c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: 6f456ca2-df7a-46af-bb96-7226ec9ccf70] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:56.823366 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4296bc98-6f59-4050-90bc-6a550ee341a0 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.490602 Jun 29 12:34:56.823995 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 114/252] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:56 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:56.838613 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6d483e80-7705-48f0-a26e-8f658ca1c46c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:56.839067 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6d483e80-7705-48f0-a26e-8f658ca1c46c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:56.839829 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6d483e80-7705-48f0-a26e-8f658ca1c46c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:56.840263 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6d483e80-7705-48f0-a26e-8f658ca1c46c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:56.990107 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6d483e80-7705-48f0-a26e-8f658ca1c46c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:56.998902 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6d483e80-7705-48f0-a26e-8f658ca1c46c tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70" status: 200 len: 1502 microversion: 2.1 time: 0.179903 Jun 29 12:34:56.999542 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 139/253] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:56 2022] GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70 => generated 1502 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:57.841710 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3149912b-5b37-4c35-a254-a0300d67959d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:57.842996 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3149912b-5b37-4c35-a254-a0300d67959d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:57.852429 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3149912b-5b37-4c35-a254-a0300d67959d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:57.853095 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3149912b-5b37-4c35-a254-a0300d67959d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:57.853951 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3149912b-5b37-4c35-a254-a0300d67959d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:57.854483 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3149912b-5b37-4c35-a254-a0300d67959d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:58.006689 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3149912b-5b37-4c35-a254-a0300d67959d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:58.013626 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3149912b-5b37-4c35-a254-a0300d67959d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.176238 Jun 29 12:34:58.014457 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 115/254] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:57 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:34:58.018682 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-df254b3f-76bf-45c2-ae35-08710fd746e0 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:58.020092 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-df254b3f-76bf-45c2-ae35-08710fd746e0 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: 6f456ca2-df7a-46af-bb96-7226ec9ccf70] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:58.026815 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-df254b3f-76bf-45c2-ae35-08710fd746e0 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:58.027256 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-df254b3f-76bf-45c2-ae35-08710fd746e0 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:58.028015 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-df254b3f-76bf-45c2-ae35-08710fd746e0 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:58.028559 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-df254b3f-76bf-45c2-ae35-08710fd746e0 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:58.168878 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-df254b3f-76bf-45c2-ae35-08710fd746e0 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:58.176666 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-df254b3f-76bf-45c2-ae35-08710fd746e0 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70" status: 200 len: 1502 microversion: 2.1 time: 0.163658 Jun 29 12:34:58.177225 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 140/255] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:58 2022] GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70 => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:59.031974 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8e2c0a03-411c-442c-b601-0b79e33442b7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:59.034393 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8e2c0a03-411c-442c-b601-0b79e33442b7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:59.042232 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8e2c0a03-411c-442c-b601-0b79e33442b7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:59.042944 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8e2c0a03-411c-442c-b601-0b79e33442b7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:59.043893 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8e2c0a03-411c-442c-b601-0b79e33442b7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:59.044486 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8e2c0a03-411c-442c-b601-0b79e33442b7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:59.196216 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-264caa97-bbd9-4266-8392-a1abf2949b05 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:34:59.197609 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-264caa97-bbd9-4266-8392-a1abf2949b05 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: 6f456ca2-df7a-46af-bb96-7226ec9ccf70] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:34:59.227246 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-264caa97-bbd9-4266-8392-a1abf2949b05 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:59.228175 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-264caa97-bbd9-4266-8392-a1abf2949b05 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:59.231226 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-264caa97-bbd9-4266-8392-a1abf2949b05 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:59.233110 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-264caa97-bbd9-4266-8392-a1abf2949b05 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:59.403779 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-264caa97-bbd9-4266-8392-a1abf2949b05 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bba6a17fc19645c29fce6fa655095a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed93385ff03f4672acc79e103ffcb82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:59.412830 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-264caa97-bbd9-4266-8392-a1abf2949b05 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70" status: 200 len: 1460 microversion: 2.1 time: 0.221712 Jun 29 12:34:59.413416 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 141/256] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:59 2022] GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70 => generated 1460 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:59.454656 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8e2c0a03-411c-442c-b601-0b79e33442b7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:34:59.469684 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-a5c3d8c0-7935-4e4b-b3a4-1dd49a5b007b req-5b8ce59e-cffb-48cc-86cb-9ec49d92fb13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f456ca2-df7a-46af-bb96-7226ec9ccf70", "name": "network-vif-deleted", "tag": "cee3ccfd-1b4c-4337-9108-8c4324eec706"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:34:59.480144 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8e2c0a03-411c-442c-b601-0b79e33442b7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.452457 Jun 29 12:34:59.494521 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 116/257] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:34:59 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:34:59.497564 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-a5c3d8c0-7935-4e4b-b3a4-1dd49a5b007b req-5b8ce59e-cffb-48cc-86cb-9ec49d92fb13 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:34:59.498221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-a5c3d8c0-7935-4e4b-b3a4-1dd49a5b007b req-5b8ce59e-cffb-48cc-86cb-9ec49d92fb13 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:34:59.515504 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-a5c3d8c0-7935-4e4b-b3a4-1dd49a5b007b req-5b8ce59e-cffb-48cc-86cb-9ec49d92fb13 service nova] Creating event network-vif-deleted:cee3ccfd-1b4c-4337-9108-8c4324eec706 for instance 6f456ca2-df7a-46af-bb96-7226ec9ccf70 on hv-cinder-81268 Jun 29 12:34:59.532636 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-a5c3d8c0-7935-4e4b-b3a4-1dd49a5b007b req-5b8ce59e-cffb-48cc-86cb-9ec49d92fb13 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070729 Jun 29 12:34:59.533254 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 142/258] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:35:00.430588 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8e17b21b-81f6-4642-bee4-aec4d30014d5 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:00.431206 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8e17b21b-81f6-4642-bee4-aec4d30014d5 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] [instance: 6f456ca2-df7a-46af-bb96-7226ec9ccf70] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:00.437977 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8e17b21b-81f6-4642-bee4-aec4d30014d5 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:00.438436 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8e17b21b-81f6-4642-bee4-aec4d30014d5 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:00.439896 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8e17b21b-81f6-4642-bee4-aec4d30014d5 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:00.440466 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8e17b21b-81f6-4642-bee4-aec4d30014d5 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:00.453378 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-8e17b21b-81f6-4642-bee4-aec4d30014d5 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] HTTP exception thrown: Instance 6f456ca2-df7a-46af-bb96-7226ec9ccf70 could not be found. Jun 29 12:35:00.455337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8e17b21b-81f6-4642-bee4-aec4d30014d5 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Request method failure captured: Jun 29 12:35:00.455337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70 HTTP/1.1 Jun 29 12:35:00.455337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept: application/json Jun 29 12:35:00.455337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jun 29 12:35:00.455337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Connection: close Jun 29 12:35:00.455337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jun 29 12:35:00.455337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jun 29 12:35:00.455337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Host: 10.222.0.52 Jun 29 12:35:00.455337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jun 29 12:35:00.455337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jun 29 12:35:00.455337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivEazlg7ttPVLC6BkABJXoUM6gwlpNX3HggDiXmhybAwG9e_NEoBQgnwXAfZhqoUYmiGy58pUkA6-jpPcrU1e6QldustBRo7tOlzUhs9kW-3inZ1RhFCDiYY42tarIyeDm4Ba7HhalUxiaXkbn8viA5hpHSypuqtqLCDXE-pmMA50ldw Jun 29 12:35:00.455337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jun 29 12:35:00.455337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jun 29 12:35:00.455337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jun 29 12:35:00.455337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jun 29 12:35:00.455337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jun 29 12:35:00.455337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jun 29 12:35:00.455337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Id: ed93385ff03f4672acc79e103ffcb82e Jun 29 12:35:00.455337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-VolumesActionsTest-2028320997 Jun 29 12:35:00.455337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jun 29 12:35:00.455337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jun 29 12:35:00.456946 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ed93385ff03f4672acc79e103ffcb82e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ed93385ff03f4672acc79e103ffcb82e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed93385ff03f4672acc79e103ffcb82e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed93385ff03f4672acc79e103ffcb82e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:35:00.456946 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-VolumesActionsTest-2028320997 Jun 29 12:35:00.456946 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Id: ed93385ff03f4672acc79e103ffcb82e Jun 29 12:35:00.456946 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-VolumesActionsTest-2028320997 Jun 29 12:35:00.456946 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User: tempest-VolumesActionsTest-2028320997-project Jun 29 12:35:00.456946 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jun 29 12:35:00.456946 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jun 29 12:35:00.456946 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Id: bba6a17fc19645c29fce6fa655095a0a Jun 29 12:35:00.456946 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-VolumesActionsTest-2028320997-project Jun 29 12:35:00.456946 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: method: > Jun 29 12:35:00.456946 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: exception: Instance 6f456ca2-df7a-46af-bb96-7226ec9ccf70 could not be found. Jun 29 12:35:00.456946 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: action_args: {'id': '6f456ca2-df7a-46af-bb96-7226ec9ccf70'} Jun 29 12:35:00.457692 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:35:00.457692 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:35:00.457692 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:35:00.457692 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:35:00.457692 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:35:00.457692 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:35:00.457692 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:35:00.457692 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:35:00.457692 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:35:00.457692 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:35:00.457692 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f456ca2-df7a-46af-bb96-7226ec9ccf70 could not be found. Jun 29 12:35:00.457692 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:35:00.457692 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:35:00.457692 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:35:00.457692 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:35:00.457692 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:35:00.457692 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:35:00.457692 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:35:00.457692 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:35:00.457692 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:35:00.458840 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:35:00.458840 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:35:00.458840 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:35:00.458840 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:35:00.458840 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:35:00.458840 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:35:00.458840 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:35:00.458840 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f456ca2-df7a-46af-bb96-7226ec9ccf70 could not be found. Jun 29 12:35:00.458840 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:35:00.458840 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:35:00.458840 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:35:00.458840 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:35:00.458840 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:35:00.458840 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:35:00.458840 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:35:00.458840 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:35:00.458840 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f456ca2-df7a-46af-bb96-7226ec9ccf70 could not be found. Jun 29 12:35:00.458840 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:35:00.459863 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8e17b21b-81f6-4642-bee4-aec4d30014d5 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] Returning 404 to user: Instance 6f456ca2-df7a-46af-bb96-7226ec9ccf70 could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:35:00.459863 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8e17b21b-81f6-4642-bee4-aec4d30014d5 tempest-VolumesActionsTest-2028320997 tempest-VolumesActionsTest-2028320997-project] 10.222.0.52 "GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70" status: 404 len: 111 microversion: 2.1 time: 0.029997 Jun 29 12:35:00.459863 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 117/259] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:00 2022] GET /compute/v2.1/servers/6f456ca2-df7a-46af-bb96-7226ec9ccf70 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:35:00.500212 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6d9b7cc0-fae4-4c02-83d7-06f75a2ea4d5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:00.500898 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-6d9b7cc0-fae4-4c02-83d7-06f75a2ea4d5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:00.507980 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6d9b7cc0-fae4-4c02-83d7-06f75a2ea4d5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:00.508424 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6d9b7cc0-fae4-4c02-83d7-06f75a2ea4d5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:00.510602 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6d9b7cc0-fae4-4c02-83d7-06f75a2ea4d5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:00.511051 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6d9b7cc0-fae4-4c02-83d7-06f75a2ea4d5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:00.649447 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6d9b7cc0-fae4-4c02-83d7-06f75a2ea4d5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:00.657359 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6d9b7cc0-fae4-4c02-83d7-06f75a2ea4d5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.161240 Jun 29 12:35:00.658731 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 143/260] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:00 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:01.675501 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-25eb6bf2-06de-4ee4-9cf0-ec31c2f40434 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:01.676115 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-25eb6bf2-06de-4ee4-9cf0-ec31c2f40434 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:01.683033 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-25eb6bf2-06de-4ee4-9cf0-ec31c2f40434 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:01.683486 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-25eb6bf2-06de-4ee4-9cf0-ec31c2f40434 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:01.684256 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-25eb6bf2-06de-4ee4-9cf0-ec31c2f40434 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:01.684696 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-25eb6bf2-06de-4ee4-9cf0-ec31c2f40434 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:01.690127 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=100 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:35:01.947390 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-25eb6bf2-06de-4ee4-9cf0-ec31c2f40434 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:01.957137 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-25eb6bf2-06de-4ee4-9cf0-ec31c2f40434 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.286196 Jun 29 12:35:01.958160 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 118/261] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:01 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:02.974365 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1495a6cd-99c1-46da-bb46-57b17267c9d0 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:02.975169 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1495a6cd-99c1-46da-bb46-57b17267c9d0 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:02.981266 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1495a6cd-99c1-46da-bb46-57b17267c9d0 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:02.981709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1495a6cd-99c1-46da-bb46-57b17267c9d0 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:02.982489 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1495a6cd-99c1-46da-bb46-57b17267c9d0 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:02.982922 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1495a6cd-99c1-46da-bb46-57b17267c9d0 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:03.131949 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1495a6cd-99c1-46da-bb46-57b17267c9d0 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:03.140134 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1495a6cd-99c1-46da-bb46-57b17267c9d0 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.170275 Jun 29 12:35:03.142894 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 144/262] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:02 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:04.158386 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d95a68eb-42e0-43f0-9502-f5765631d9d9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:04.159159 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d95a68eb-42e0-43f0-9502-f5765631d9d9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:04.167146 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d95a68eb-42e0-43f0-9502-f5765631d9d9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:04.167851 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d95a68eb-42e0-43f0-9502-f5765631d9d9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:04.168704 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d95a68eb-42e0-43f0-9502-f5765631d9d9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:04.169228 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d95a68eb-42e0-43f0-9502-f5765631d9d9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:04.322036 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d95a68eb-42e0-43f0-9502-f5765631d9d9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:04.330480 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d95a68eb-42e0-43f0-9502-f5765631d9d9 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.176470 Jun 29 12:35:04.331060 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 119/263] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:04 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:05.354355 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d1799165-435b-405a-9873-b8e4adbe268b tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:05.356187 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d1799165-435b-405a-9873-b8e4adbe268b tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:05.368966 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d1799165-435b-405a-9873-b8e4adbe268b tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:05.370685 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d1799165-435b-405a-9873-b8e4adbe268b tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:05.373409 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d1799165-435b-405a-9873-b8e4adbe268b tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:05.374620 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d1799165-435b-405a-9873-b8e4adbe268b tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:05.602562 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d1799165-435b-405a-9873-b8e4adbe268b tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:05.631379 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d1799165-435b-405a-9873-b8e4adbe268b tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.288167 Jun 29 12:35:05.632485 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 145/264] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:05 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:06.655924 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a4fefb06-f8df-4397-afa7-e43d27e8f025 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:06.657170 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a4fefb06-f8df-4397-afa7-e43d27e8f025 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:06.666036 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a4fefb06-f8df-4397-afa7-e43d27e8f025 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:06.666897 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a4fefb06-f8df-4397-afa7-e43d27e8f025 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:06.668299 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a4fefb06-f8df-4397-afa7-e43d27e8f025 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:06.669155 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a4fefb06-f8df-4397-afa7-e43d27e8f025 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:07.129414 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-a4fefb06-f8df-4397-afa7-e43d27e8f025 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:07.140852 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a4fefb06-f8df-4397-afa7-e43d27e8f025 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1521 microversion: 2.1 time: 0.495441 Jun 29 12:35:07.156604 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 120/265] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:06 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1521 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:08.163272 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-45d5ab47-3c1f-4fee-bcdd-d0fd334716d8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:08.163796 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-45d5ab47-3c1f-4fee-bcdd-d0fd334716d8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:08.190757 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:35:08.223640 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-45d5ab47-3c1f-4fee-bcdd-d0fd334716d8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:08.224508 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-45d5ab47-3c1f-4fee-bcdd-d0fd334716d8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:08.225551 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-45d5ab47-3c1f-4fee-bcdd-d0fd334716d8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:08.226212 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-45d5ab47-3c1f-4fee-bcdd-d0fd334716d8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:08.511769 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-45d5ab47-3c1f-4fee-bcdd-d0fd334716d8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:08.520741 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-45d5ab47-3c1f-4fee-bcdd-d0fd334716d8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1501 microversion: 2.1 time: 0.363302 Jun 29 12:35:08.533581 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 146/266] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:08 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1501 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:35:08.554371 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9588405b-2a94-4128-90b1-2818773e3887 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:08.555015 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-9588405b-2a94-4128-90b1-2818773e3887 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:08.566763 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9588405b-2a94-4128-90b1-2818773e3887 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:08.567303 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9588405b-2a94-4128-90b1-2818773e3887 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:08.568086 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9588405b-2a94-4128-90b1-2818773e3887 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:08.568524 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9588405b-2a94-4128-90b1-2818773e3887 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:09.009688 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9588405b-2a94-4128-90b1-2818773e3887 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:09.029782 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9588405b-2a94-4128-90b1-2818773e3887 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1517 microversion: 2.1 time: 0.479705 Jun 29 12:35:09.037797 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 121/267] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:08 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1517 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:10.930026 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8b176d49-1a2e-4857-9e60-af5b673efc94 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:35:10.931374 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8b176d49-1a2e-4857-9e60-af5b673efc94 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:10.939010 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8b176d49-1a2e-4857-9e60-af5b673efc94 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:10.941618 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8b176d49-1a2e-4857-9e60-af5b673efc94 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:10.943530 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8b176d49-1a2e-4857-9e60-af5b673efc94 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:10.946236 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8b176d49-1a2e-4857-9e60-af5b673efc94 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:11.006596 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-8b176d49-1a2e-4857-9e60-af5b673efc94 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lazy-loading 'flavor' on Instance uuid f2fe6e32-c192-444c-8fa1-df3767145bc0 {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 12:35:11.215445 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8b176d49-1a2e-4857-9e60-af5b673efc94 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "POST /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0/action" status: 200 len: 32 microversion: 2.1 time: 0.288314 Jun 29 12:35:11.220873 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 147/268] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 12:35:10 2022] POST /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0/action => generated 32 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 12:35:11.227765 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-55379f05-8af4-4e32-8bd9-03c88d03dced tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:11.228399 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-55379f05-8af4-4e32-8bd9-03c88d03dced tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:11.248165 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-55379f05-8af4-4e32-8bd9-03c88d03dced tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:11.251553 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-55379f05-8af4-4e32-8bd9-03c88d03dced tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:11.252697 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-55379f05-8af4-4e32-8bd9-03c88d03dced tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:11.253856 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-55379f05-8af4-4e32-8bd9-03c88d03dced tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:11.597234 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-55379f05-8af4-4e32-8bd9-03c88d03dced tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:11.617139 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-55379f05-8af4-4e32-8bd9-03c88d03dced tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1523 microversion: 2.1 time: 0.394016 Jun 29 12:35:11.618259 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 122/269] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:11 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1523 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:12.638953 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-24d5e950-7a43-473b-a60b-ef3bb664ff46 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:12.640309 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-24d5e950-7a43-473b-a60b-ef3bb664ff46 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:12.656291 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-24d5e950-7a43-473b-a60b-ef3bb664ff46 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:12.656969 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-24d5e950-7a43-473b-a60b-ef3bb664ff46 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:12.658507 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-24d5e950-7a43-473b-a60b-ef3bb664ff46 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:12.663255 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-24d5e950-7a43-473b-a60b-ef3bb664ff46 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:13.132278 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-24d5e950-7a43-473b-a60b-ef3bb664ff46 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:13.156315 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-24d5e950-7a43-473b-a60b-ef3bb664ff46 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1523 microversion: 2.1 time: 0.522649 Jun 29 12:35:13.160632 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 148/270] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:12 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1523 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:14.177208 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4988d9c9-0ae8-4485-b312-c9a7259215be tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:14.178386 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4988d9c9-0ae8-4485-b312-c9a7259215be tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:14.194113 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4988d9c9-0ae8-4485-b312-c9a7259215be tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:14.194700 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4988d9c9-0ae8-4485-b312-c9a7259215be tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:14.196476 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4988d9c9-0ae8-4485-b312-c9a7259215be tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:14.198090 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4988d9c9-0ae8-4485-b312-c9a7259215be tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:14.513806 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4988d9c9-0ae8-4485-b312-c9a7259215be tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:14.526618 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4988d9c9-0ae8-4485-b312-c9a7259215be tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1523 microversion: 2.1 time: 0.353554 Jun 29 12:35:14.532402 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 123/271] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:14 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1523 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:15.549729 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b0f86e9c-8d59-48b9-9ce8-39bcd07b1746 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:15.550450 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b0f86e9c-8d59-48b9-9ce8-39bcd07b1746 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:15.564937 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b0f86e9c-8d59-48b9-9ce8-39bcd07b1746 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:15.565812 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b0f86e9c-8d59-48b9-9ce8-39bcd07b1746 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:15.570681 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b0f86e9c-8d59-48b9-9ce8-39bcd07b1746 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:15.571413 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b0f86e9c-8d59-48b9-9ce8-39bcd07b1746 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:16.078556 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b0f86e9c-8d59-48b9-9ce8-39bcd07b1746 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:16.111020 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:35:16.119312 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b0f86e9c-8d59-48b9-9ce8-39bcd07b1746 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1523 microversion: 2.1 time: 0.573924 Jun 29 12:35:16.139820 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 149/272] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:15 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1523 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:17.056636 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-32a70ee0-d4ce-467a-9bbd-b59525e02701 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:17.057144 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-32a70ee0-d4ce-467a-9bbd-b59525e02701 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:17.069716 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-32a70ee0-d4ce-467a-9bbd-b59525e02701 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:17.070178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-32a70ee0-d4ce-467a-9bbd-b59525e02701 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:17.071003 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-32a70ee0-d4ce-467a-9bbd-b59525e02701 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:17.071438 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-32a70ee0-d4ce-467a-9bbd-b59525e02701 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:17.128874 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-32a70ee0-d4ce-467a-9bbd-b59525e02701 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4/ips" status: 200 len: 146 microversion: 2.1 time: 0.076447 Jun 29 12:35:17.130019 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 124/273] 10.222.0.52 () {58 vars in 1247 bytes} [Wed Jun 29 12:35:17 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4/ips => generated 146 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:35:17.152093 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5e475a4e-e69e-4a0b-82ee-d2d577968e5c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:17.152718 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5e475a4e-e69e-4a0b-82ee-d2d577968e5c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:17.164383 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5e475a4e-e69e-4a0b-82ee-d2d577968e5c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:17.164517 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5e475a4e-e69e-4a0b-82ee-d2d577968e5c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:17.165202 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5e475a4e-e69e-4a0b-82ee-d2d577968e5c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:17.165641 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5e475a4e-e69e-4a0b-82ee-d2d577968e5c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:17.428203 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5e475a4e-e69e-4a0b-82ee-d2d577968e5c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:17.442203 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5e475a4e-e69e-4a0b-82ee-d2d577968e5c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1523 microversion: 2.1 time: 0.296962 Jun 29 12:35:17.447528 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 150/274] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:17 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1523 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:18.464699 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-764c69e5-3a34-452e-8c5c-feae7d98d907 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:18.465312 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-764c69e5-3a34-452e-8c5c-feae7d98d907 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:18.477333 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-764c69e5-3a34-452e-8c5c-feae7d98d907 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:18.478223 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-764c69e5-3a34-452e-8c5c-feae7d98d907 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:18.480086 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-764c69e5-3a34-452e-8c5c-feae7d98d907 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:18.480756 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-764c69e5-3a34-452e-8c5c-feae7d98d907 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:18.746172 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-764c69e5-3a34-452e-8c5c-feae7d98d907 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:18.755211 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-764c69e5-3a34-452e-8c5c-feae7d98d907 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1523 microversion: 2.1 time: 0.294437 Jun 29 12:35:18.756396 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 125/275] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:18 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1523 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:19.780753 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6e414a2c-4ca9-4d10-aadc-0e2c5cced54e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:19.782310 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6e414a2c-4ca9-4d10-aadc-0e2c5cced54e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:19.795479 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-cc998f2d-5d34-446f-a644-79492437169c tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Action: 'create', calling method: .version_select at 0x7fdb06a89a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-112282750", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcWKHrrotsmw4LfAgs6HcXmmvOQTfJVecuoqOaabQs1Z2V7gtB4HkJMrpOex6+Hvzi2yOZyEmlj6hUGU15jCqHhVyHMDKJEp0wYoxcRITNYLneMH3kqJoOCcMyXo4FrLw=="}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:35:19.812544 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=34 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:35:19.818370 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6e414a2c-4ca9-4d10-aadc-0e2c5cced54e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:19.821524 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6e414a2c-4ca9-4d10-aadc-0e2c5cced54e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:19.823020 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6e414a2c-4ca9-4d10-aadc-0e2c5cced54e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:19.824658 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6e414a2c-4ca9-4d10-aadc-0e2c5cced54e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:19.848070 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-cc998f2d-5d34-446f-a644-79492437169c tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Getting quotas for project aacced43dbbb4c2e98bdff0d3cc557ad. Resources: {'key_pairs'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:35:19.862015 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-cc998f2d-5d34-446f-a644-79492437169c tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Getting quotas for user f026018d7f444519983df75eb4453284 and project aacced43dbbb4c2e98bdff0d3cc557ad. Resources: {'key_pairs'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:35:19.941639 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-cc998f2d-5d34-446f-a644-79492437169c tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.506572 Jun 29 12:35:19.942887 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 151/276] 10.222.0.52 () {60 vars in 1158 bytes} [Wed Jun 29 12:35:19 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:35:20.165844 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6e414a2c-4ca9-4d10-aadc-0e2c5cced54e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:20.181141 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6e414a2c-4ca9-4d10-aadc-0e2c5cced54e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1523 microversion: 2.1 time: 0.409484 Jun 29 12:35:20.182921 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 126/277] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:19 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1523 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:35:21.200219 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c9c4a648-7ffc-4158-b9a2-fe328a092e71 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:21.201364 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c9c4a648-7ffc-4158-b9a2-fe328a092e71 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:21.214261 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c9c4a648-7ffc-4158-b9a2-fe328a092e71 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:21.214931 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c9c4a648-7ffc-4158-b9a2-fe328a092e71 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:21.215896 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c9c4a648-7ffc-4158-b9a2-fe328a092e71 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:21.220178 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c9c4a648-7ffc-4158-b9a2-fe328a092e71 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:21.596568 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6732ded8-1e72-4169-a3c6-486e281126ba tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6e33ddf-2c1d-4487-bc23-f5dc32deeb6f"}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:35:21.597632 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6732ded8-1e72-4169-a3c6-486e281126ba tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:21.605045 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6732ded8-1e72-4169-a3c6-486e281126ba tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:21.605715 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6732ded8-1e72-4169-a3c6-486e281126ba tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:21.614947 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6732ded8-1e72-4169-a3c6-486e281126ba tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:21.615834 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6732ded8-1e72-4169-a3c6-486e281126ba tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:21.809770 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c9c4a648-7ffc-4158-b9a2-fe328a092e71 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:21.818943 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c9c4a648-7ffc-4158-b9a2-fe328a092e71 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1523 microversion: 2.1 time: 0.623441 Jun 29 12:35:21.830860 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 152/278] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:21 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1523 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:22.065816 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6732ded8-1e72-4169-a3c6-486e281126ba tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "POST /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.476832 Jun 29 12:35:22.067696 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 127/279] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Jun 29 12:35:21 2022] POST /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4/os-volume_attachments => generated 194 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:35:22.837155 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-52a7ab05-c263-4a9e-ab1f-43a0be7f4b42 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:22.837768 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-52a7ab05-c263-4a9e-ab1f-43a0be7f4b42 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:22.844068 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-52a7ab05-c263-4a9e-ab1f-43a0be7f4b42 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:22.848935 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-52a7ab05-c263-4a9e-ab1f-43a0be7f4b42 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:22.856493 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-52a7ab05-c263-4a9e-ab1f-43a0be7f4b42 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:22.857478 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-52a7ab05-c263-4a9e-ab1f-43a0be7f4b42 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:23.066274 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-52a7ab05-c263-4a9e-ab1f-43a0be7f4b42 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:23.076267 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-52a7ab05-c263-4a9e-ab1f-43a0be7f4b42 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1523 microversion: 2.1 time: 0.243113 Jun 29 12:35:23.077876 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 153/280] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:22 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1523 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:23.945929 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-70889ee0-0711-4b24-8c11-41d384faeda2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:23.947563 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-70889ee0-0711-4b24-8c11-41d384faeda2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:23.956832 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-70889ee0-0711-4b24-8c11-41d384faeda2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:23.957515 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-70889ee0-0711-4b24-8c11-41d384faeda2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:23.958802 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-70889ee0-0711-4b24-8c11-41d384faeda2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:23.959427 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-70889ee0-0711-4b24-8c11-41d384faeda2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:23.992178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-70889ee0-0711-4b24-8c11-41d384faeda2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86/ips" status: 200 len: 151 microversion: 2.20 time: 0.053017 Jun 29 12:35:23.993293 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 128/281] 10.222.0.52 () {60 vars in 1288 bytes} [Wed Jun 29 12:35:23 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86/ips => generated 151 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 12:35:24.097988 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-97c49431-f593-45b9-9daf-e1f6c859d686 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:24.098655 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-97c49431-f593-45b9-9daf-e1f6c859d686 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:24.110088 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-97c49431-f593-45b9-9daf-e1f6c859d686 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:24.110976 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-97c49431-f593-45b9-9daf-e1f6c859d686 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:24.111941 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-97c49431-f593-45b9-9daf-e1f6c859d686 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:24.112596 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-97c49431-f593-45b9-9daf-e1f6c859d686 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:24.406696 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-97c49431-f593-45b9-9daf-e1f6c859d686 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:24.428166 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-97c49431-f593-45b9-9daf-e1f6c859d686 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1523 microversion: 2.1 time: 0.334279 Jun 29 12:35:24.431074 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 154/282] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:24 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1523 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:25.448820 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6f51f740-485f-4003-b754-b8cda66db8d5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:25.449647 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6f51f740-485f-4003-b754-b8cda66db8d5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:25.462062 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6f51f740-485f-4003-b754-b8cda66db8d5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:25.462764 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6f51f740-485f-4003-b754-b8cda66db8d5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:25.463702 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6f51f740-485f-4003-b754-b8cda66db8d5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:25.467928 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6f51f740-485f-4003-b754-b8cda66db8d5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:25.781697 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6f51f740-485f-4003-b754-b8cda66db8d5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:25.792879 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6f51f740-485f-4003-b754-b8cda66db8d5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1523 microversion: 2.1 time: 0.347755 Jun 29 12:35:25.804760 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 129/283] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:25 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1523 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:26.279932 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-fe588261-12ca-4924-929d-1694a36181e0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:35:26.280641 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-fe588261-12ca-4924-929d-1694a36181e0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:26.287468 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fe588261-12ca-4924-929d-1694a36181e0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:26.288176 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fe588261-12ca-4924-929d-1694a36181e0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:26.289207 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fe588261-12ca-4924-929d-1694a36181e0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:26.289795 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fe588261-12ca-4924-929d-1694a36181e0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:26.342731 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-fe588261-12ca-4924-929d-1694a36181e0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lazy-loading 'flavor' on Instance uuid d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 12:35:26.817927 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1d879ba1-2d07-42f5-9d77-85c053d074b5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:26.819695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-1d879ba1-2d07-42f5-9d77-85c053d074b5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:26.837972 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1d879ba1-2d07-42f5-9d77-85c053d074b5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:26.839194 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1d879ba1-2d07-42f5-9d77-85c053d074b5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:26.842678 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1d879ba1-2d07-42f5-9d77-85c053d074b5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:26.844848 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1d879ba1-2d07-42f5-9d77-85c053d074b5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:27.202789 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-1d879ba1-2d07-42f5-9d77-85c053d074b5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:27.211723 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-1d879ba1-2d07-42f5-9d77-85c053d074b5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1523 microversion: 2.1 time: 0.400102 Jun 29 12:35:27.213003 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 130/284] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:26 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1523 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:28.229499 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8a41fc96-cf4f-4776-bf65-5b6388c0d06c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:28.230876 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8a41fc96-cf4f-4776-bf65-5b6388c0d06c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:28.241613 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8a41fc96-cf4f-4776-bf65-5b6388c0d06c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:28.243640 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8a41fc96-cf4f-4776-bf65-5b6388c0d06c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:28.245443 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8a41fc96-cf4f-4776-bf65-5b6388c0d06c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:28.246464 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8a41fc96-cf4f-4776-bf65-5b6388c0d06c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:28.471015 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8a41fc96-cf4f-4776-bf65-5b6388c0d06c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:28.485313 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8a41fc96-cf4f-4776-bf65-5b6388c0d06c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1523 microversion: 2.1 time: 0.259856 Jun 29 12:35:28.495583 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 131/285] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:28 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:35:29.010698 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-066c71dd-2ec5-4b8a-9542-2b2729e49a3e tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:35:29.028621 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-066c71dd-2ec5-4b8a-9542-2b2729e49a3e tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:29.029730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-066c71dd-2ec5-4b8a-9542-2b2729e49a3e tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:29.130574 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-066c71dd-2ec5-4b8a-9542-2b2729e49a3e tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Going to try to stop instance {{(pid=124316) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 29 12:35:29.214107 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-066c71dd-2ec5-4b8a-9542-2b2729e49a3e tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "POST /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4/action" status: 202 len: 0 microversion: 2.1 time: 0.207343 Jun 29 12:35:29.218017 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 132/286] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 12:35:29 2022] POST /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:35:29.226722 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ff4ce8e1-9f34-4bd2-a946-aa049370b95a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:29.227557 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ff4ce8e1-9f34-4bd2-a946-aa049370b95a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:29.237764 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ff4ce8e1-9f34-4bd2-a946-aa049370b95a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:29.238550 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ff4ce8e1-9f34-4bd2-a946-aa049370b95a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:29.240266 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ff4ce8e1-9f34-4bd2-a946-aa049370b95a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:29.240825 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ff4ce8e1-9f34-4bd2-a946-aa049370b95a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:29.248718 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:35:29.490827 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ff4ce8e1-9f34-4bd2-a946-aa049370b95a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:29.502526 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ff4ce8e1-9f34-4bd2-a946-aa049370b95a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1725 microversion: 2.1 time: 0.282352 Jun 29 12:35:29.503100 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 133/287] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:29 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1725 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:29.520920 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1bdd76e2-19a8-4499-9d05-b490de496556 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:29.522068 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-1bdd76e2-19a8-4499-9d05-b490de496556 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:29.532957 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1bdd76e2-19a8-4499-9d05-b490de496556 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:29.534260 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1bdd76e2-19a8-4499-9d05-b490de496556 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:29.535294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1bdd76e2-19a8-4499-9d05-b490de496556 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:29.535991 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1bdd76e2-19a8-4499-9d05-b490de496556 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:29.730864 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-1bdd76e2-19a8-4499-9d05-b490de496556 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:29.740063 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-1bdd76e2-19a8-4499-9d05-b490de496556 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1523 microversion: 2.1 time: 0.235542 Jun 29 12:35:29.741843 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 134/288] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:29 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1523 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:29.893548 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=4 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:35:30.522491 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a1af6713-f349-41fb-a070-61efb23e158a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:30.523706 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a1af6713-f349-41fb-a070-61efb23e158a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:30.530548 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a1af6713-f349-41fb-a070-61efb23e158a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:30.531005 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a1af6713-f349-41fb-a070-61efb23e158a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:30.532330 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a1af6713-f349-41fb-a070-61efb23e158a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:30.532822 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a1af6713-f349-41fb-a070-61efb23e158a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:30.684706 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-a1af6713-f349-41fb-a070-61efb23e158a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:30.694660 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a1af6713-f349-41fb-a070-61efb23e158a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1725 microversion: 2.1 time: 0.176198 Jun 29 12:35:30.695454 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 135/289] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:30 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:30.762532 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-315cda24-81c0-4920-9c8c-8bb5c4b6b365 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:30.763399 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-315cda24-81c0-4920-9c8c-8bb5c4b6b365 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:30.774632 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-315cda24-81c0-4920-9c8c-8bb5c4b6b365 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:30.775095 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-315cda24-81c0-4920-9c8c-8bb5c4b6b365 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:30.778584 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-315cda24-81c0-4920-9c8c-8bb5c4b6b365 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:30.779304 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-315cda24-81c0-4920-9c8c-8bb5c4b6b365 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:30.964331 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-315cda24-81c0-4920-9c8c-8bb5c4b6b365 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:30.972483 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-315cda24-81c0-4920-9c8c-8bb5c4b6b365 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1523 microversion: 2.1 time: 0.214018 Jun 29 12:35:30.973309 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 136/290] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:30 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:35:31.713228 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-102973be-fd38-410d-a5d4-13bb824d4a21 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:31.713937 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-102973be-fd38-410d-a5d4-13bb824d4a21 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:31.722879 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-102973be-fd38-410d-a5d4-13bb824d4a21 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:31.723308 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-102973be-fd38-410d-a5d4-13bb824d4a21 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:31.724272 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-102973be-fd38-410d-a5d4-13bb824d4a21 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:31.724707 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-102973be-fd38-410d-a5d4-13bb824d4a21 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:31.874074 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-102973be-fd38-410d-a5d4-13bb824d4a21 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:31.883636 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-102973be-fd38-410d-a5d4-13bb824d4a21 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1725 microversion: 2.1 time: 0.174923 Jun 29 12:35:31.884276 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 137/291] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:31 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:35:31.992064 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-23232790-88ce-47f7-89ed-e30e248dd50a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:31.992695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-23232790-88ce-47f7-89ed-e30e248dd50a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:31.999587 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-23232790-88ce-47f7-89ed-e30e248dd50a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:32.000042 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-23232790-88ce-47f7-89ed-e30e248dd50a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:32.002093 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-23232790-88ce-47f7-89ed-e30e248dd50a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:32.002561 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-23232790-88ce-47f7-89ed-e30e248dd50a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:32.166948 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-23232790-88ce-47f7-89ed-e30e248dd50a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:32.175656 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-23232790-88ce-47f7-89ed-e30e248dd50a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1523 microversion: 2.1 time: 0.187745 Jun 29 12:35:32.176660 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 138/292] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:31 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:32.439515 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-fe588261-12ca-4924-929d-1694a36181e0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "POST /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86/action" status: 202 len: 0 microversion: 2.20 time: 6.164934 Jun 29 12:35:32.440140 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 155/293] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Jun 29 12:35:26 2022] POST /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86/action => generated 0 bytes in 6166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 29 12:35:32.448518 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-54460096-4c27-4638-afc5-6d469856cab9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:32.449128 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-54460096-4c27-4638-afc5-6d469856cab9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:32.455832 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-54460096-4c27-4638-afc5-6d469856cab9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:32.456279 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-54460096-4c27-4638-afc5-6d469856cab9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:32.457037 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-54460096-4c27-4638-afc5-6d469856cab9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:32.457473 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-54460096-4c27-4638-afc5-6d469856cab9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:32.623281 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-54460096-4c27-4638-afc5-6d469856cab9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:32.631801 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-54460096-4c27-4638-afc5-6d469856cab9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:32.633398 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-54460096-4c27-4638-afc5-6d469856cab9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:32.634670 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-54460096-4c27-4638-afc5-6d469856cab9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1722 microversion: 2.20 time: 0.190053 Jun 29 12:35:32.635284 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 139/294] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:35:32 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:35:32.902184 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f6b0b096-dd3b-4e7a-81ad-4ab9ba687548 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:32.903126 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f6b0b096-dd3b-4e7a-81ad-4ab9ba687548 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:32.912939 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f6b0b096-dd3b-4e7a-81ad-4ab9ba687548 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:32.913513 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f6b0b096-dd3b-4e7a-81ad-4ab9ba687548 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:32.914478 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f6b0b096-dd3b-4e7a-81ad-4ab9ba687548 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:32.914979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f6b0b096-dd3b-4e7a-81ad-4ab9ba687548 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:33.066324 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f6b0b096-dd3b-4e7a-81ad-4ab9ba687548 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:33.074858 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f6b0b096-dd3b-4e7a-81ad-4ab9ba687548 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1725 microversion: 2.1 time: 0.176924 Jun 29 12:35:33.075423 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 156/295] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:32 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:33.194532 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-53f3faf5-cfaf-4e7b-8480-32f9c68637a6 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:33.196065 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-53f3faf5-cfaf-4e7b-8480-32f9c68637a6 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:33.203078 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-53f3faf5-cfaf-4e7b-8480-32f9c68637a6 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:33.204071 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-53f3faf5-cfaf-4e7b-8480-32f9c68637a6 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:33.204838 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-53f3faf5-cfaf-4e7b-8480-32f9c68637a6 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:33.205270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-53f3faf5-cfaf-4e7b-8480-32f9c68637a6 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:33.411203 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-53f3faf5-cfaf-4e7b-8480-32f9c68637a6 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:33.418730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-53f3faf5-cfaf-4e7b-8480-32f9c68637a6 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1523 microversion: 2.1 time: 0.229089 Jun 29 12:35:33.419440 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 140/296] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:33 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:35:33.653813 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-20b951dc-733d-484f-b176-8fbea0a27ce9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:33.654500 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-20b951dc-733d-484f-b176-8fbea0a27ce9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:33.662778 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-20b951dc-733d-484f-b176-8fbea0a27ce9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:33.663527 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-20b951dc-733d-484f-b176-8fbea0a27ce9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:33.664704 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-20b951dc-733d-484f-b176-8fbea0a27ce9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:33.665436 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-20b951dc-733d-484f-b176-8fbea0a27ce9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:33.831486 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-20b951dc-733d-484f-b176-8fbea0a27ce9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:33.840340 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-20b951dc-733d-484f-b176-8fbea0a27ce9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:33.841838 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-20b951dc-733d-484f-b176-8fbea0a27ce9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:33.843016 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-20b951dc-733d-484f-b176-8fbea0a27ce9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1722 microversion: 2.20 time: 0.193810 Jun 29 12:35:33.843689 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 157/297] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:35:33 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:35:34.092790 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ec550c43-5660-426f-92ee-9ec87d82672e tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:34.093649 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ec550c43-5660-426f-92ee-9ec87d82672e tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:34.101142 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ec550c43-5660-426f-92ee-9ec87d82672e tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:34.102070 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ec550c43-5660-426f-92ee-9ec87d82672e tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:34.103201 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ec550c43-5660-426f-92ee-9ec87d82672e tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:34.103894 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ec550c43-5660-426f-92ee-9ec87d82672e tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:34.265611 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ec550c43-5660-426f-92ee-9ec87d82672e tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:34.283256 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ec550c43-5660-426f-92ee-9ec87d82672e tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1725 microversion: 2.1 time: 0.187108 Jun 29 12:35:34.283256 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 141/298] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:34 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:34.436809 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0cea1c59-9c6f-4e3f-910c-38ec5736ec7f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:34.438379 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0cea1c59-9c6f-4e3f-910c-38ec5736ec7f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:34.445472 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0cea1c59-9c6f-4e3f-910c-38ec5736ec7f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:34.445954 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0cea1c59-9c6f-4e3f-910c-38ec5736ec7f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:34.447038 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0cea1c59-9c6f-4e3f-910c-38ec5736ec7f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:34.447631 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0cea1c59-9c6f-4e3f-910c-38ec5736ec7f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:34.584471 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0cea1c59-9c6f-4e3f-910c-38ec5736ec7f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:34.592556 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0cea1c59-9c6f-4e3f-910c-38ec5736ec7f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1523 microversion: 2.1 time: 0.159780 Jun 29 12:35:34.593121 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 158/299] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:34 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:34.862175 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-7ffed415-bfe1-4741-8878-a4db653fa234 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:34.862829 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-7ffed415-bfe1-4741-8878-a4db653fa234 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:34.868721 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7ffed415-bfe1-4741-8878-a4db653fa234 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:34.869172 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7ffed415-bfe1-4741-8878-a4db653fa234 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:34.869930 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7ffed415-bfe1-4741-8878-a4db653fa234 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:34.870372 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7ffed415-bfe1-4741-8878-a4db653fa234 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:34.999777 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7ffed415-bfe1-4741-8878-a4db653fa234 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:35.008698 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7ffed415-bfe1-4741-8878-a4db653fa234 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:35.010199 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7ffed415-bfe1-4741-8878-a4db653fa234 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:35.011399 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-7ffed415-bfe1-4741-8878-a4db653fa234 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1722 microversion: 2.20 time: 0.153732 Jun 29 12:35:35.011956 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 142/300] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:35:34 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:35:35.294571 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-25b738a7-ab62-4aaf-b4ce-5d194153c9b6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:35.295280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-25b738a7-ab62-4aaf-b4ce-5d194153c9b6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:35.302662 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-25b738a7-ab62-4aaf-b4ce-5d194153c9b6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:35.303118 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-25b738a7-ab62-4aaf-b4ce-5d194153c9b6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:35.303888 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-25b738a7-ab62-4aaf-b4ce-5d194153c9b6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:35.304326 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-25b738a7-ab62-4aaf-b4ce-5d194153c9b6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:35.515750 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-25b738a7-ab62-4aaf-b4ce-5d194153c9b6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:35.524696 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-25b738a7-ab62-4aaf-b4ce-5d194153c9b6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1725 microversion: 2.1 time: 0.234495 Jun 29 12:35:35.525262 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 159/301] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:35 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1725 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:35:35.610302 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f54c8cf5-616b-48ef-be29-3ff9e4714d2c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:35.610930 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f54c8cf5-616b-48ef-be29-3ff9e4714d2c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:35.617448 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f54c8cf5-616b-48ef-be29-3ff9e4714d2c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:35.617888 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f54c8cf5-616b-48ef-be29-3ff9e4714d2c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:35.618677 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f54c8cf5-616b-48ef-be29-3ff9e4714d2c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:35.619106 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f54c8cf5-616b-48ef-be29-3ff9e4714d2c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:35.769608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f54c8cf5-616b-48ef-be29-3ff9e4714d2c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:35.778654 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f54c8cf5-616b-48ef-be29-3ff9e4714d2c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1503 microversion: 2.1 time: 0.172843 Jun 29 12:35:35.779536 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 143/302] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:35 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:35.799827 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-33fa748f-8689-44ff-b68f-090e8ae8b708 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e488f58-95f0-4c3f-b0ff-acbba1c6a4cd"}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:35:35.801033 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-33fa748f-8689-44ff-b68f-090e8ae8b708 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:35.807738 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-33fa748f-8689-44ff-b68f-090e8ae8b708 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:35.808188 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-33fa748f-8689-44ff-b68f-090e8ae8b708 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:35.808946 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-33fa748f-8689-44ff-b68f-090e8ae8b708 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:35.809373 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-33fa748f-8689-44ff-b68f-090e8ae8b708 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:35.855626 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-33fa748f-8689-44ff-b68f-090e8ae8b708 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] HTTP exception thrown: Cannot 'attach_volume' instance f2fe6e32-c192-444c-8fa1-df3767145bc0 while it is in vm_state rescued Jun 29 12:35:35.857751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-33fa748f-8689-44ff-b68f-090e8ae8b708 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Request method failure captured: Jun 29 12:35:35.857751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: POST /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0/os-volume_attachments HTTP/1.1 Jun 29 12:35:35.857751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:35:35.857751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:35:35.857751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:35:35.857751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 74 Jun 29 12:35:35.857751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:35:35.857751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:35:35.857751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:35:35.857751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:35:35.857751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEabg5iVMEbOJzCwdOCwPxnKhRE8xvAH6FjMNwILYHvgdAsYTJbCxQBGWRog2gvt81PgL8lF8nPUVAT6C20WS8IP2YDtPNfSU3z3-biFYl82u8OpR9Rn0KOwxc725AZY3ac1c00Qu2nph6va0WgPmO9r1VgnqYNalOsYrn_-l7oCAZY Jun 29 12:35:35.857751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:35:35.857751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:35:35.857751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:35:35.857751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:35:35.857751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:35:35.857751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:35:35.857751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: 8be6d4a4e2344e25b7661d69a9e222c8 Jun 29 12:35:35.857751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-117238858 Jun 29 12:35:35.857751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:35:35.857751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:35:35.859356 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8be6d4a4e2344e25b7661d69a9e222c8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8be6d4a4e2344e25b7661d69a9e222c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8be6d4a4e2344e25b7661d69a9e222c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8be6d4a4e2344e25b7661d69a9e222c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:35:35.859356 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-ServerRescueNegativeTestJSON-117238858 Jun 29 12:35:35.859356 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 8be6d4a4e2344e25b7661d69a9e222c8 Jun 29 12:35:35.859356 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-117238858 Jun 29 12:35:35.859356 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-ServerRescueNegativeTestJSON-117238858-project Jun 29 12:35:35.859356 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:35:35.859356 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:35:35.859356 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: 350a57ee307a4419974dcecf37e466e5 Jun 29 12:35:35.859356 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-ServerRescueNegativeTestJSON-117238858-project Jun 29 12:35:35.859356 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Jun 29 12:35:35.859356 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {"volumeAttachment": {"volumeId": "9e488f58-95f0-4c3f-b0ff-acbba1c6a4cd"}} Jun 29 12:35:35.859356 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:35:35.860848 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Cannot 'attach_volume' instance f2fe6e32-c192-444c-8fa1-df3767145bc0 while it is in vm_state rescued Jun 29 12:35:35.860848 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'server_id': 'f2fe6e32-c192-444c-8fa1-df3767145bc0', 'body': {'volumeAttachment': {'volumeId': '9e488f58-95f0-4c3f-b0ff-acbba1c6a4cd'}}} Jun 29 12:35:35.860848 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:35:35.860848 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:35:35.860848 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 29 12:35:35.860848 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 29 12:35:35.860848 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 12:35:35.860848 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 12:35:35.860848 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 29 12:35:35.860848 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 29 12:35:35.860848 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2fe6e32-c192-444c-8fa1-df3767145bc0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 29 12:35:35.860848 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:35:35.860848 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:35:35.860848 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:35:35.860848 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:35:35.860848 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:35:35.860848 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:35:35.860848 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:35:35.860848 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:35:35.862201 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:35:35.862201 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:35:35.862201 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 12:35:35.862201 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 12:35:35.862201 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 12:35:35.862201 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 12:35:35.862201 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 12:35:35.862201 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 12:35:35.862201 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 29 12:35:35.862201 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 29 12:35:35.862201 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 29 12:35:35.862201 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 29 12:35:35.862201 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f2fe6e32-c192-444c-8fa1-df3767145bc0 while it is in vm_state rescued Jun 29 12:35:35.862201 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:35:35.862201 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:35:35.862201 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:35:35.862201 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:35:35.862201 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:35:35.862201 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:35:35.863717 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:35:35.863717 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:35:35.863717 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f2fe6e32-c192-444c-8fa1-df3767145bc0 while it is in vm_state rescued Jun 29 12:35:35.863717 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:35:35.863717 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-33fa748f-8689-44ff-b68f-090e8ae8b708 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Returning 409 to user: Cannot 'attach_volume' instance f2fe6e32-c192-444c-8fa1-df3767145bc0 while it is in vm_state rescued {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:35:35.864344 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-33fa748f-8689-44ff-b68f-090e8ae8b708 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "POST /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.069546 Jun 29 12:35:35.868834 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 160/303] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Jun 29 12:35:35 2022] POST /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0/os-volume_attachments => generated 152 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 29 12:35:35.876007 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4856ac25-f50b-46bf-b570-2cf875b8763d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:35:35.879006 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4856ac25-f50b-46bf-b570-2cf875b8763d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:35.885597 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4856ac25-f50b-46bf-b570-2cf875b8763d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:35.886055 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4856ac25-f50b-46bf-b570-2cf875b8763d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:35.886874 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4856ac25-f50b-46bf-b570-2cf875b8763d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:35.887307 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4856ac25-f50b-46bf-b570-2cf875b8763d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:35.906292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3ccb51a0-e06f-47bd-b8e1-2bc3c7d0b70a tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1625596396", "imageRef": "70887696-f652-46b0-a5be-bfb400986078", "flavorRef": "452"}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:35:35.965353 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.network.neutron [None req-3ccb51a0-e06f-47bd-b8e1-2bc3c7d0b70a tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] validate_networks() for None {{(pid=124317) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 12:35:35.966784 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4856ac25-f50b-46bf-b570-2cf875b8763d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "POST /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0/action" status: 202 len: 0 microversion: 2.1 time: 0.095843 Jun 29 12:35:35.967785 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 144/304] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 12:35:35 2022] POST /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:35:35.977747 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-38e8b1c3-58c0-4ec6-9f30-9adc2bcb617d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:35.979003 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-38e8b1c3-58c0-4ec6-9f30-9adc2bcb617d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:35.987392 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-38e8b1c3-58c0-4ec6-9f30-9adc2bcb617d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:35.988290 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-38e8b1c3-58c0-4ec6-9f30-9adc2bcb617d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:35.989473 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-38e8b1c3-58c0-4ec6-9f30-9adc2bcb617d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:35.990159 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-38e8b1c3-58c0-4ec6-9f30-9adc2bcb617d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:36.290401 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-3ccb51a0-e06f-47bd-b8e1-2bc3c7d0b70a tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Flavor limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 12:35:36.290871 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-3ccb51a0-e06f-47bd-b8e1-2bc3c7d0b70a tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Image limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 12:35:36.291344 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-3ccb51a0-e06f-47bd-b8e1-2bc3c7d0b70a tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Flavor pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 12:35:36.291751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-3ccb51a0-e06f-47bd-b8e1-2bc3c7d0b70a tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Image pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 12:35:36.292158 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-3ccb51a0-e06f-47bd-b8e1-2bc3c7d0b70a tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 12:35:36.301618 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3ccb51a0-e06f-47bd-b8e1-2bc3c7d0b70a tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:36.302203 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3ccb51a0-e06f-47bd-b8e1-2bc3c7d0b70a tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:36.302869 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3ccb51a0-e06f-47bd-b8e1-2bc3c7d0b70a tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:36.303304 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3ccb51a0-e06f-47bd-b8e1-2bc3c7d0b70a tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:36.318604 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-38e8b1c3-58c0-4ec6-9f30-9adc2bcb617d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:36.321628 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-3ccb51a0-e06f-47bd-b8e1-2bc3c7d0b70a tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Getting quotas for project f826993a33644995a3150d71cc40add7. Resources: {'cores', 'ram', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:35:36.325639 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-3ccb51a0-e06f-47bd-b8e1-2bc3c7d0b70a tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Getting quotas for user c2518c8b1d0146dcb93fd4e875389f66 and project f826993a33644995a3150d71cc40add7. Resources: {'cores', 'ram', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:35:36.326388 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-38e8b1c3-58c0-4ec6-9f30-9adc2bcb617d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1511 microversion: 2.1 time: 0.353576 Jun 29 12:35:36.327225 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 145/305] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:35 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1511 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:36.336049 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e35b73a8-1d64-405c-901c-e970358e7392 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:36.336981 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e35b73a8-1d64-405c-901c-e970358e7392 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:36.340839 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3ccb51a0-e06f-47bd-b8e1-2bc3c7d0b70a tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Going to run 1 instances... {{(pid=124317) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 12:35:36.343125 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3ccb51a0-e06f-47bd-b8e1-2bc3c7d0b70a tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] [instance: 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70887696-f652-46b0-a5be-bfb400986078',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124317) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 12:35:36.344653 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e35b73a8-1d64-405c-901c-e970358e7392 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:36.345178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e35b73a8-1d64-405c-901c-e970358e7392 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:36.346047 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e35b73a8-1d64-405c-901c-e970358e7392 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:36.346580 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e35b73a8-1d64-405c-901c-e970358e7392 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:36.397961 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3ccb51a0-e06f-47bd-b8e1-2bc3c7d0b70a tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.495426 Jun 29 12:35:36.402639 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 161/306] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 12:35:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 12:35:36.409560 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a8d45666-d419-444b-b1c7-36418f26c7dc tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:36.410213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a8d45666-d419-444b-b1c7-36418f26c7dc tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] [instance: 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:36.475743 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a8d45666-d419-444b-b1c7-36418f26c7dc tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2518c8b1d0146dcb93fd4e875389f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f826993a33644995a3150d71cc40add7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:36.482784 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a8d45666-d419-444b-b1c7-36418f26c7dc tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3" status: 200 len: 1215 microversion: 2.1 time: 0.077887 Jun 29 12:35:36.483358 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 162/307] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:36 2022] GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:35:36.541058 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3375ca51-f70d-44e8-9f50-372de38a5e68 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:36.541722 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3375ca51-f70d-44e8-9f50-372de38a5e68 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:36.549852 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3375ca51-f70d-44e8-9f50-372de38a5e68 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:36.550617 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3375ca51-f70d-44e8-9f50-372de38a5e68 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:36.551399 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3375ca51-f70d-44e8-9f50-372de38a5e68 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:36.551830 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3375ca51-f70d-44e8-9f50-372de38a5e68 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:36.711349 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3375ca51-f70d-44e8-9f50-372de38a5e68 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:36.722257 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3375ca51-f70d-44e8-9f50-372de38a5e68 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1725 microversion: 2.1 time: 0.184713 Jun 29 12:35:36.723031 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 163/308] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:36 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:35:36.903536 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e35b73a8-1d64-405c-901c-e970358e7392 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:36.913817 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e35b73a8-1d64-405c-901c-e970358e7392 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:36.915344 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e35b73a8-1d64-405c-901c-e970358e7392 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:36.916506 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e35b73a8-1d64-405c-901c-e970358e7392 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1722 microversion: 2.20 time: 0.586980 Jun 29 12:35:36.917232 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 146/309] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:35:36 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1722 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:35:37.348591 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3978452d-4144-489b-b155-e2f4bc092057 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:37.350342 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3978452d-4144-489b-b155-e2f4bc092057 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:37.362523 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3978452d-4144-489b-b155-e2f4bc092057 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:37.362971 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3978452d-4144-489b-b155-e2f4bc092057 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:37.363792 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3978452d-4144-489b-b155-e2f4bc092057 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:37.364248 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3978452d-4144-489b-b155-e2f4bc092057 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:37.500729 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-66c8e439-c61c-4905-86bc-ca468af341be tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:37.502034 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-66c8e439-c61c-4905-86bc-ca468af341be tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] [instance: 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:37.508979 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-66c8e439-c61c-4905-86bc-ca468af341be tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:37.509689 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-66c8e439-c61c-4905-86bc-ca468af341be tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:37.510730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-66c8e439-c61c-4905-86bc-ca468af341be tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:37.511527 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-66c8e439-c61c-4905-86bc-ca468af341be tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:37.551681 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3978452d-4144-489b-b155-e2f4bc092057 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:37.559208 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3978452d-4144-489b-b155-e2f4bc092057 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1511 microversion: 2.1 time: 0.217921 Jun 29 12:35:37.564154 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 164/310] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:37 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1511 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:37.629121 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-66c8e439-c61c-4905-86bc-ca468af341be tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2518c8b1d0146dcb93fd4e875389f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f826993a33644995a3150d71cc40add7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:37.642026 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-66c8e439-c61c-4905-86bc-ca468af341be tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3" status: 200 len: 1275 microversion: 2.1 time: 0.144642 Jun 29 12:35:37.643323 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 147/311] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:37 2022] GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 => generated 1275 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:37.741926 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b9535e86-77ae-4ded-94d7-d9860b2f1ad6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:37.742561 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b9535e86-77ae-4ded-94d7-d9860b2f1ad6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:37.749430 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b9535e86-77ae-4ded-94d7-d9860b2f1ad6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:37.749875 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b9535e86-77ae-4ded-94d7-d9860b2f1ad6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:37.752382 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b9535e86-77ae-4ded-94d7-d9860b2f1ad6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:37.752759 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b9535e86-77ae-4ded-94d7-d9860b2f1ad6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:37.897059 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b9535e86-77ae-4ded-94d7-d9860b2f1ad6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:37.905449 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b9535e86-77ae-4ded-94d7-d9860b2f1ad6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1725 microversion: 2.1 time: 0.167213 Jun 29 12:35:37.906202 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 165/312] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:37 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:37.939466 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1fb00031-db4a-4b36-ac7e-cf7981cd245f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:37.940083 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-1fb00031-db4a-4b36-ac7e-cf7981cd245f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:37.946352 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1fb00031-db4a-4b36-ac7e-cf7981cd245f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:37.947205 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1fb00031-db4a-4b36-ac7e-cf7981cd245f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:37.947607 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1fb00031-db4a-4b36-ac7e-cf7981cd245f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:37.948046 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1fb00031-db4a-4b36-ac7e-cf7981cd245f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:38.085257 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-1fb00031-db4a-4b36-ac7e-cf7981cd245f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:38.088782 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:35:38.095547 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-1fb00031-db4a-4b36-ac7e-cf7981cd245f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:38.097110 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-1fb00031-db4a-4b36-ac7e-cf7981cd245f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:38.098261 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-1fb00031-db4a-4b36-ac7e-cf7981cd245f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1722 microversion: 2.20 time: 0.163935 Jun 29 12:35:38.098839 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 148/313] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:35:37 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:35:38.580746 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1bcf5919-e40f-46b6-a119-94e90a5097a2 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:38.581395 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1bcf5919-e40f-46b6-a119-94e90a5097a2 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:38.583575 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:35:38.589681 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1bcf5919-e40f-46b6-a119-94e90a5097a2 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:38.590105 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1bcf5919-e40f-46b6-a119-94e90a5097a2 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:38.591008 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1bcf5919-e40f-46b6-a119-94e90a5097a2 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:38.591441 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1bcf5919-e40f-46b6-a119-94e90a5097a2 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:38.669198 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b7058747-f20f-402d-a1f6-2c3cb8223fc7 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:38.670024 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b7058747-f20f-402d-a1f6-2c3cb8223fc7 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] [instance: 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:38.678613 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b7058747-f20f-402d-a1f6-2c3cb8223fc7 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:38.679282 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b7058747-f20f-402d-a1f6-2c3cb8223fc7 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:38.680142 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b7058747-f20f-402d-a1f6-2c3cb8223fc7 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:38.680772 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b7058747-f20f-402d-a1f6-2c3cb8223fc7 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:38.745214 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1bcf5919-e40f-46b6-a119-94e90a5097a2 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:38.755149 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1bcf5919-e40f-46b6-a119-94e90a5097a2 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1511 microversion: 2.1 time: 0.178108 Jun 29 12:35:38.756147 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 166/314] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:38 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:38.764015 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b7058747-f20f-402d-a1f6-2c3cb8223fc7 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2518c8b1d0146dcb93fd4e875389f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f826993a33644995a3150d71cc40add7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:38.772077 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b7058747-f20f-402d-a1f6-2c3cb8223fc7 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3" status: 200 len: 1285 microversion: 2.1 time: 0.111321 Jun 29 12:35:38.772631 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 149/315] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:38 2022] GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 => generated 1285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:35:38.923608 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d20df5bb-14c5-4e32-891b-e786cba7a7c9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:38.924218 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d20df5bb-14c5-4e32-891b-e786cba7a7c9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:38.930671 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d20df5bb-14c5-4e32-891b-e786cba7a7c9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:38.931125 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d20df5bb-14c5-4e32-891b-e786cba7a7c9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:38.931885 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d20df5bb-14c5-4e32-891b-e786cba7a7c9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:38.932319 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d20df5bb-14c5-4e32-891b-e786cba7a7c9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:38.952905 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:35:39.083948 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d20df5bb-14c5-4e32-891b-e786cba7a7c9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:39.095315 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d20df5bb-14c5-4e32-891b-e786cba7a7c9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1725 microversion: 2.1 time: 0.174124 Jun 29 12:35:39.096230 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 167/316] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:38 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:39.118609 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5ba0e86e-0bb0-4c52-b8ef-ed00ba191688 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:39.120105 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5ba0e86e-0bb0-4c52-b8ef-ed00ba191688 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:39.128994 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5ba0e86e-0bb0-4c52-b8ef-ed00ba191688 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:39.129520 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5ba0e86e-0bb0-4c52-b8ef-ed00ba191688 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:39.130360 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5ba0e86e-0bb0-4c52-b8ef-ed00ba191688 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:39.130865 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5ba0e86e-0bb0-4c52-b8ef-ed00ba191688 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:39.341160 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5ba0e86e-0bb0-4c52-b8ef-ed00ba191688 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:39.351206 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5ba0e86e-0bb0-4c52-b8ef-ed00ba191688 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:39.352846 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5ba0e86e-0bb0-4c52-b8ef-ed00ba191688 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:39.354094 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5ba0e86e-0bb0-4c52-b8ef-ed00ba191688 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1722 microversion: 2.20 time: 0.240848 Jun 29 12:35:39.354758 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 150/317] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:35:39 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:35:39.772491 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5c48cb31-695a-4956-b2c4-733cce4cb246 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:39.773225 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5c48cb31-695a-4956-b2c4-733cce4cb246 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:39.781023 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5c48cb31-695a-4956-b2c4-733cce4cb246 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:39.782186 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5c48cb31-695a-4956-b2c4-733cce4cb246 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:39.782991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5c48cb31-695a-4956-b2c4-733cce4cb246 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:39.783358 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5c48cb31-695a-4956-b2c4-733cce4cb246 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:39.793911 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ca253a56-7158-43b7-92e8-f71fb188399c tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:39.794551 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ca253a56-7158-43b7-92e8-f71fb188399c tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] [instance: 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:39.802324 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ca253a56-7158-43b7-92e8-f71fb188399c tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:39.802827 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ca253a56-7158-43b7-92e8-f71fb188399c tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:39.803599 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ca253a56-7158-43b7-92e8-f71fb188399c tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:39.804167 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ca253a56-7158-43b7-92e8-f71fb188399c tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:39.929264 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5c48cb31-695a-4956-b2c4-733cce4cb246 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:39.943373 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5c48cb31-695a-4956-b2c4-733cce4cb246 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1517 microversion: 2.1 time: 0.174913 Jun 29 12:35:39.955467 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 168/318] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:39 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1517 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:40.029234 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ca253a56-7158-43b7-92e8-f71fb188399c tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2518c8b1d0146dcb93fd4e875389f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f826993a33644995a3150d71cc40add7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:40.043879 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ca253a56-7158-43b7-92e8-f71fb188399c tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3" status: 200 len: 1315 microversion: 2.1 time: 0.253993 Jun 29 12:35:40.044617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 151/319] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:39 2022] GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:40.113056 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ecb6ec0d-2c9a-491b-88c0-369c8cf5480b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:40.113761 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ecb6ec0d-2c9a-491b-88c0-369c8cf5480b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:40.121260 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ecb6ec0d-2c9a-491b-88c0-369c8cf5480b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:40.121870 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ecb6ec0d-2c9a-491b-88c0-369c8cf5480b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:40.122766 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ecb6ec0d-2c9a-491b-88c0-369c8cf5480b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:40.123361 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ecb6ec0d-2c9a-491b-88c0-369c8cf5480b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:40.303644 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ecb6ec0d-2c9a-491b-88c0-369c8cf5480b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:40.316027 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ecb6ec0d-2c9a-491b-88c0-369c8cf5480b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1725 microversion: 2.1 time: 0.208096 Jun 29 12:35:40.317064 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 169/320] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:40 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1725 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:40.373830 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-72e021ab-4435-4898-bbff-cd010ee4b079 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:40.374579 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-72e021ab-4435-4898-bbff-cd010ee4b079 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:40.381492 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-72e021ab-4435-4898-bbff-cd010ee4b079 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:40.382028 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-72e021ab-4435-4898-bbff-cd010ee4b079 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:40.383250 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-72e021ab-4435-4898-bbff-cd010ee4b079 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:40.384138 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-72e021ab-4435-4898-bbff-cd010ee4b079 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:40.595086 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-72e021ab-4435-4898-bbff-cd010ee4b079 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:40.603220 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-72e021ab-4435-4898-bbff-cd010ee4b079 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:40.604798 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-72e021ab-4435-4898-bbff-cd010ee4b079 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:40.606159 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-72e021ab-4435-4898-bbff-cd010ee4b079 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1722 microversion: 2.20 time: 0.236970 Jun 29 12:35:40.606771 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 152/321] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:35:40 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:35:40.712226 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-a3ad71df-e892-4c6d-b825-60a7dbdbd646 req-9f3b7931-4dd7-40db-81a5-3cecd20fe5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3", "tag": "1b7d5c23-5903-4ada-bbae-d0082028f2c4"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:35:40.723530 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-a3ad71df-e892-4c6d-b825-60a7dbdbd646 req-9f3b7931-4dd7-40db-81a5-3cecd20fe5e1 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:40.723958 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-a3ad71df-e892-4c6d-b825-60a7dbdbd646 req-9f3b7931-4dd7-40db-81a5-3cecd20fe5e1 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:40.751892 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-a3ad71df-e892-4c6d-b825-60a7dbdbd646 req-9f3b7931-4dd7-40db-81a5-3cecd20fe5e1 service nova] Creating event network-changed:1b7d5c23-5903-4ada-bbae-d0082028f2c4 for instance 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 on hv-cinder-81268 Jun 29 12:35:40.757146 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-a3ad71df-e892-4c6d-b825-60a7dbdbd646 req-9f3b7931-4dd7-40db-81a5-3cecd20fe5e1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048780 Jun 29 12:35:40.757754 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 170/322] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:35:41.071058 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c33f689f-9baa-415f-8b32-c55168be5aaf tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:41.071675 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c33f689f-9baa-415f-8b32-c55168be5aaf tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] [instance: 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:41.078060 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c33f689f-9baa-415f-8b32-c55168be5aaf tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:41.078576 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c33f689f-9baa-415f-8b32-c55168be5aaf tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:41.079353 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c33f689f-9baa-415f-8b32-c55168be5aaf tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:41.079794 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c33f689f-9baa-415f-8b32-c55168be5aaf tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:41.236872 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c33f689f-9baa-415f-8b32-c55168be5aaf tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2518c8b1d0146dcb93fd4e875389f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f826993a33644995a3150d71cc40add7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:41.244381 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c33f689f-9baa-415f-8b32-c55168be5aaf tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3" status: 200 len: 1315 microversion: 2.1 time: 0.177209 Jun 29 12:35:41.245039 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 153/323] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:41 2022] GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:41.333346 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c0217abf-5116-4e7e-a84c-d4b474d922b2 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:41.334045 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c0217abf-5116-4e7e-a84c-d4b474d922b2 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:41.340479 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c0217abf-5116-4e7e-a84c-d4b474d922b2 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:41.340930 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c0217abf-5116-4e7e-a84c-d4b474d922b2 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:41.341061 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-72bc0427-b73f-4afa-9299-1b1f494b959b tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Action: 'create', calling method: .version_select at 0x7fdb06ada0d0>, body: {"keypair": {"name": "tempest-keypair-1758771067", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGbD+9rJKrl+BLsWd/9elJjQttPJcWBRy61LgO9RoVUrpG7b8vmb3p2c9/I7/SS22UpfWdtAuLMgCjXYy2ROczzzPIDLQAsjvBDYxMx1FNNO0m+xJ4dFQPGpbclB4YJcA=="}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:35:41.341694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c0217abf-5116-4e7e-a84c-d4b474d922b2 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:41.342134 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c0217abf-5116-4e7e-a84c-d4b474d922b2 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:41.355994 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-72bc0427-b73f-4afa-9299-1b1f494b959b tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Getting quotas for project 8be6d4a4e2344e25b7661d69a9e222c8. Resources: {'key_pairs'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:35:41.371099 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-72bc0427-b73f-4afa-9299-1b1f494b959b tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Getting quotas for user 350a57ee307a4419974dcecf37e466e5 and project 8be6d4a4e2344e25b7661d69a9e222c8. Resources: {'key_pairs'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:35:41.398334 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-72bc0427-b73f-4afa-9299-1b1f494b959b tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.061266 Jun 29 12:35:41.399032 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 154/324] 10.222.0.52 () {60 vars in 1158 bytes} [Wed Jun 29 12:35:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:35:41.489373 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c0217abf-5116-4e7e-a84c-d4b474d922b2 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:41.502616 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c0217abf-5116-4e7e-a84c-d4b474d922b2 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1725 microversion: 2.1 time: 0.172963 Jun 29 12:35:41.504019 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 171/325] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:41 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:41.626819 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-32c7cfda-9957-4fdb-b0eb-34da186a0080 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:41.627690 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-32c7cfda-9957-4fdb-b0eb-34da186a0080 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:41.633898 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-32c7cfda-9957-4fdb-b0eb-34da186a0080 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:41.634494 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-32c7cfda-9957-4fdb-b0eb-34da186a0080 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:41.635351 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-32c7cfda-9957-4fdb-b0eb-34da186a0080 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:41.635888 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-32c7cfda-9957-4fdb-b0eb-34da186a0080 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:41.783190 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-32c7cfda-9957-4fdb-b0eb-34da186a0080 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:41.791179 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-32c7cfda-9957-4fdb-b0eb-34da186a0080 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:41.793005 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-32c7cfda-9957-4fdb-b0eb-34da186a0080 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:41.794258 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-32c7cfda-9957-4fdb-b0eb-34da186a0080 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1722 microversion: 2.20 time: 0.173095 Jun 29 12:35:41.794853 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 155/326] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:35:41 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:35:42.074725 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3eee3b2e-a780-49fd-a442-2006275a52e1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1977008791", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-112282750", "security_groups": [{"name": "tempest-secgroup-smoke-2134144518"}], "networks": [{"uuid": "ca85be79-dcc1-4564-a978-271ecca83135"}], "block_device_mapping_v2": [{"uuid": "aa31a49e-56ca-43b5-a439-28e9478b304f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:35:42.251373 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.network.neutron [None req-3eee3b2e-a780-49fd-a442-2006275a52e1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] validate_networks() for [('ca85be79-dcc1-4564-a978-271ecca83135', None, None, None, None, None)] {{(pid=124317) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 12:35:42.261904 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-7310ce86-8d9a-4d0e-961c-d127bd15a1d2 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:42.262519 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-7310ce86-8d9a-4d0e-961c-d127bd15a1d2 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] [instance: 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:42.269940 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7310ce86-8d9a-4d0e-961c-d127bd15a1d2 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:42.270676 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7310ce86-8d9a-4d0e-961c-d127bd15a1d2 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:42.271470 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7310ce86-8d9a-4d0e-961c-d127bd15a1d2 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:42.272051 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7310ce86-8d9a-4d0e-961c-d127bd15a1d2 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:42.516898 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7310ce86-8d9a-4d0e-961c-d127bd15a1d2 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2518c8b1d0146dcb93fd4e875389f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f826993a33644995a3150d71cc40add7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:42.525281 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-7310ce86-8d9a-4d0e-961c-d127bd15a1d2 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3" status: 200 len: 1315 microversion: 2.1 time: 0.267634 Jun 29 12:35:42.526106 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 156/327] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:42 2022] GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:42.530854 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b9aec3f1-a1e0-4a55-aca9-6a4721a813ab tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:42.531599 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b9aec3f1-a1e0-4a55-aca9-6a4721a813ab tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:42.538159 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b9aec3f1-a1e0-4a55-aca9-6a4721a813ab tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:42.539208 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b9aec3f1-a1e0-4a55-aca9-6a4721a813ab tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:42.540163 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b9aec3f1-a1e0-4a55-aca9-6a4721a813ab tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:42.540704 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b9aec3f1-a1e0-4a55-aca9-6a4721a813ab tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:42.767883 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b9aec3f1-a1e0-4a55-aca9-6a4721a813ab tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:42.778462 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b9aec3f1-a1e0-4a55-aca9-6a4721a813ab tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1725 microversion: 2.1 time: 0.251102 Jun 29 12:35:42.779473 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 157/328] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:42 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1725 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:42.813768 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-7a389a44-e5cc-4819-bac4-7e2c52b1e9af tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:42.814405 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-7a389a44-e5cc-4819-bac4-7e2c52b1e9af tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:42.820431 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7a389a44-e5cc-4819-bac4-7e2c52b1e9af tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:42.820882 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7a389a44-e5cc-4819-bac4-7e2c52b1e9af tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:42.821641 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7a389a44-e5cc-4819-bac4-7e2c52b1e9af tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:42.822081 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7a389a44-e5cc-4819-bac4-7e2c52b1e9af tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:42.960767 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7a389a44-e5cc-4819-bac4-7e2c52b1e9af tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:42.968896 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7a389a44-e5cc-4819-bac4-7e2c52b1e9af tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:42.970483 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7a389a44-e5cc-4819-bac4-7e2c52b1e9af tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:42.971637 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-7a389a44-e5cc-4819-bac4-7e2c52b1e9af tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1722 microversion: 2.20 time: 0.162444 Jun 29 12:35:42.972193 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 158/329] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:35:42 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:35:43.005242 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-3eee3b2e-a780-49fd-a442-2006275a52e1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Flavor limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 12:35:43.005747 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-3eee3b2e-a780-49fd-a442-2006275a52e1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Image limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 12:35:43.006141 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-3eee3b2e-a780-49fd-a442-2006275a52e1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Flavor pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 12:35:43.006581 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-3eee3b2e-a780-49fd-a442-2006275a52e1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Image pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 12:35:43.006994 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-3eee3b2e-a780-49fd-a442-2006275a52e1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 12:35:43.015569 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3eee3b2e-a780-49fd-a442-2006275a52e1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:43.016100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3eee3b2e-a780-49fd-a442-2006275a52e1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:43.017043 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3eee3b2e-a780-49fd-a442-2006275a52e1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:43.017472 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3eee3b2e-a780-49fd-a442-2006275a52e1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:43.036341 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-3eee3b2e-a780-49fd-a442-2006275a52e1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Getting quotas for project aacced43dbbb4c2e98bdff0d3cc557ad. Resources: {'cores', 'ram', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:35:43.042014 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-3eee3b2e-a780-49fd-a442-2006275a52e1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Getting quotas for user f026018d7f444519983df75eb4453284 and project aacced43dbbb4c2e98bdff0d3cc557ad. Resources: {'cores', 'ram', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:35:43.113139 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3eee3b2e-a780-49fd-a442-2006275a52e1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Going to run 1 instances... {{(pid=124317) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 12:35:43.115239 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3eee3b2e-a780-49fd-a442-2006275a52e1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aa31a49e-56ca-43b5-a439-28e9478b304f',volume_size=None,volume_type=None)] {{(pid=124317) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 12:35:43.183254 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-29d79a51-bb52-4c1f-abd4-241d0ed9d249 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2082745704", "imageRef": "70887696-f652-46b0-a5be-bfb400986078", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "07f547a4-09fa-4dfc-8b3c-2afd951b9459"}], "security_groups": [{"name": "tempest-securitygroup--2021778811"}], "key_name": "tempest-keypair-1758771067", "user_data": "}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:35:43.264003 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3eee3b2e-a780-49fd-a442-2006275a52e1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.194510 Jun 29 12:35:43.264770 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 172/330] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 12:35:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 12:35:43.274579 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1c890e03-9310-4b04-88d6-562accdceeed tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:43.275184 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1c890e03-9310-4b04-88d6-562accdceeed tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:43.318477 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.network.neutron [None req-29d79a51-bb52-4c1f-abd4-241d0ed9d249 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] validate_networks() for [('07f547a4-09fa-4dfc-8b3c-2afd951b9459', None, None, None, None, None)] {{(pid=124316) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 12:35:43.575363 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1c890e03-9310-4b04-88d6-562accdceeed tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:43.582775 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1c890e03-9310-4b04-88d6-562accdceeed tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1088 microversion: 2.1 time: 0.312131 Jun 29 12:35:43.608988 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 173/331] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:43 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1088 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:35:43.614787 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-7869ef8a-2e11-4470-b249-53a7205cd1c1 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:43.615602 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-7869ef8a-2e11-4470-b249-53a7205cd1c1 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] [instance: 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:43.621917 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7869ef8a-2e11-4470-b249-53a7205cd1c1 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:43.626310 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7869ef8a-2e11-4470-b249-53a7205cd1c1 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:43.626310 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7869ef8a-2e11-4470-b249-53a7205cd1c1 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:43.626310 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7869ef8a-2e11-4470-b249-53a7205cd1c1 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:43.802484 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7869ef8a-2e11-4470-b249-53a7205cd1c1 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2518c8b1d0146dcb93fd4e875389f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f826993a33644995a3150d71cc40add7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:43.804781 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-29d79a51-bb52-4c1f-abd4-241d0ed9d249 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Flavor limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 12:35:43.806823 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-29d79a51-bb52-4c1f-abd4-241d0ed9d249 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Image limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 12:35:43.807486 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-29d79a51-bb52-4c1f-abd4-241d0ed9d249 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Flavor pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 12:35:43.808467 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-29d79a51-bb52-4c1f-abd4-241d0ed9d249 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Image pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 12:35:43.809175 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-29d79a51-bb52-4c1f-abd4-241d0ed9d249 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 12:35:43.811110 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-7869ef8a-2e11-4470-b249-53a7205cd1c1 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3" status: 200 len: 1315 microversion: 2.1 time: 0.199819 Jun 29 12:35:43.811968 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 174/332] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:43 2022] GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:43.818249 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-17d25568-c058-4b7e-afac-3fffc65a4a7c tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:43.819187 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-17d25568-c058-4b7e-afac-3fffc65a4a7c tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:43.825594 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-17d25568-c058-4b7e-afac-3fffc65a4a7c tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:43.826329 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-17d25568-c058-4b7e-afac-3fffc65a4a7c tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:43.828757 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-17d25568-c058-4b7e-afac-3fffc65a4a7c tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:43.829753 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-17d25568-c058-4b7e-afac-3fffc65a4a7c tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:43.838240 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-29d79a51-bb52-4c1f-abd4-241d0ed9d249 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:43.838720 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-29d79a51-bb52-4c1f-abd4-241d0ed9d249 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:43.839558 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-29d79a51-bb52-4c1f-abd4-241d0ed9d249 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:43.840001 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-29d79a51-bb52-4c1f-abd4-241d0ed9d249 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:43.873330 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-29d79a51-bb52-4c1f-abd4-241d0ed9d249 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Getting quotas for project 8be6d4a4e2344e25b7661d69a9e222c8. Resources: {'cores', 'ram', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:35:43.878386 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-29d79a51-bb52-4c1f-abd4-241d0ed9d249 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Getting quotas for user 350a57ee307a4419974dcecf37e466e5 and project 8be6d4a4e2344e25b7661d69a9e222c8. Resources: {'cores', 'ram', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:35:43.889984 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-29d79a51-bb52-4c1f-abd4-241d0ed9d249 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Going to run 1 instances... {{(pid=124316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 12:35:43.892961 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-29d79a51-bb52-4c1f-abd4-241d0ed9d249 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70887696-f652-46b0-a5be-bfb400986078',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 12:35:43.951898 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-29d79a51-bb52-4c1f-abd4-241d0ed9d249 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.775465 Jun 29 12:35:43.952828 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 159/333] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 12:35:43 2022] POST /compute/v2.1/servers => generated 409 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 29 12:35:43.975806 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fcfa058c-b7cd-4d2c-bf97-fe4740540f3f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:43.976781 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-fcfa058c-b7cd-4d2c-bf97-fe4740540f3f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:43.988146 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-17d25568-c058-4b7e-afac-3fffc65a4a7c tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:43.996680 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-17d25568-c058-4b7e-afac-3fffc65a4a7c tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1725 microversion: 2.1 time: 0.183191 Jun 29 12:35:43.997548 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 175/334] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:43 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:44.002625 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a2c02cf6-2e25-48cc-91d6-539bc58ba7cf tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:44.003553 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a2c02cf6-2e25-48cc-91d6-539bc58ba7cf tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:44.017518 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a2c02cf6-2e25-48cc-91d6-539bc58ba7cf tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:44.018787 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a2c02cf6-2e25-48cc-91d6-539bc58ba7cf tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:44.019774 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a2c02cf6-2e25-48cc-91d6-539bc58ba7cf tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:44.020846 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a2c02cf6-2e25-48cc-91d6-539bc58ba7cf tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:44.070648 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-fcfa058c-b7cd-4d2c-bf97-fe4740540f3f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:44.089243 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-fcfa058c-b7cd-4d2c-bf97-fe4740540f3f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1246 microversion: 2.1 time: 0.129636 Jun 29 12:35:44.090327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 160/335] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:43 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1246 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:35:44.201584 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a2c02cf6-2e25-48cc-91d6-539bc58ba7cf tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:44.210023 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a2c02cf6-2e25-48cc-91d6-539bc58ba7cf tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:44.211617 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a2c02cf6-2e25-48cc-91d6-539bc58ba7cf tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:44.212770 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a2c02cf6-2e25-48cc-91d6-539bc58ba7cf tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1722 microversion: 2.20 time: 0.214051 Jun 29 12:35:44.213486 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 176/336] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:35:43 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:35:44.613819 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-099a271f-e394-42cc-9d50-8382571ad116 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:44.615762 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-099a271f-e394-42cc-9d50-8382571ad116 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:44.624730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-099a271f-e394-42cc-9d50-8382571ad116 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:44.625593 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-099a271f-e394-42cc-9d50-8382571ad116 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:44.626603 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-099a271f-e394-42cc-9d50-8382571ad116 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:44.627660 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-099a271f-e394-42cc-9d50-8382571ad116 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:44.829818 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-28b54c47-4219-494d-901e-136ef84f0bd9 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:44.830346 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-28b54c47-4219-494d-901e-136ef84f0bd9 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] [instance: 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:44.836845 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-28b54c47-4219-494d-901e-136ef84f0bd9 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:44.837288 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-28b54c47-4219-494d-901e-136ef84f0bd9 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:44.838052 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-28b54c47-4219-494d-901e-136ef84f0bd9 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:44.838942 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-28b54c47-4219-494d-901e-136ef84f0bd9 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:44.954554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-099a271f-e394-42cc-9d50-8382571ad116 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:44.964868 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-099a271f-e394-42cc-9d50-8382571ad116 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1204 microversion: 2.1 time: 0.355534 Jun 29 12:35:44.966056 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 161/337] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:44 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1204 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:35:45.007003 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-28b54c47-4219-494d-901e-136ef84f0bd9 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2518c8b1d0146dcb93fd4e875389f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f826993a33644995a3150d71cc40add7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:45.014393 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c6017042-fb2b-48ef-b38b-0c2fc3071dfe tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:45.015284 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c6017042-fb2b-48ef-b38b-0c2fc3071dfe tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:45.016674 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-28b54c47-4219-494d-901e-136ef84f0bd9 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3" status: 200 len: 1315 microversion: 2.1 time: 0.190785 Jun 29 12:35:45.027507 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 177/338] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:44 2022] GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:35:45.032484 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:35:45.037441 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c6017042-fb2b-48ef-b38b-0c2fc3071dfe tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:45.038170 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c6017042-fb2b-48ef-b38b-0c2fc3071dfe tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:45.039029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c6017042-fb2b-48ef-b38b-0c2fc3071dfe tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:45.039467 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c6017042-fb2b-48ef-b38b-0c2fc3071dfe tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:45.108541 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e9e2008b-c638-456b-860b-030299119ec8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:45.110875 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e9e2008b-c638-456b-860b-030299119ec8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:45.117834 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e9e2008b-c638-456b-860b-030299119ec8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:45.118287 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e9e2008b-c638-456b-860b-030299119ec8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:45.119173 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e9e2008b-c638-456b-860b-030299119ec8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:45.119593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e9e2008b-c638-456b-860b-030299119ec8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:45.249642 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e9e2008b-c638-456b-860b-030299119ec8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:45.261342 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e9e2008b-c638-456b-860b-030299119ec8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1306 microversion: 2.1 time: 0.156753 Jun 29 12:35:45.272795 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 178/339] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:45 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1306 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:35:45.279822 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5e24c09e-2017-4d14-ae5e-a3e043c9ffe0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:45.280666 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5e24c09e-2017-4d14-ae5e-a3e043c9ffe0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:45.288160 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5e24c09e-2017-4d14-ae5e-a3e043c9ffe0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:45.288911 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5e24c09e-2017-4d14-ae5e-a3e043c9ffe0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:45.290091 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5e24c09e-2017-4d14-ae5e-a3e043c9ffe0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:45.290696 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5e24c09e-2017-4d14-ae5e-a3e043c9ffe0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:45.449736 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c6017042-fb2b-48ef-b38b-0c2fc3071dfe tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:45.461027 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c6017042-fb2b-48ef-b38b-0c2fc3071dfe tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1725 microversion: 2.1 time: 0.450727 Jun 29 12:35:45.462045 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 162/340] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:45 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1725 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:35:45.465855 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5e24c09e-2017-4d14-ae5e-a3e043c9ffe0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:45.476667 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5e24c09e-2017-4d14-ae5e-a3e043c9ffe0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:45.478651 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5e24c09e-2017-4d14-ae5e-a3e043c9ffe0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:45.479811 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5e24c09e-2017-4d14-ae5e-a3e043c9ffe0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1722 microversion: 2.20 time: 0.205566 Jun 29 12:35:45.480368 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 179/341] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:35:45 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:35:45.983100 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-95a2f2d1-7bbd-4475-b3ae-99c8dce4aebc tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:45.983760 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-95a2f2d1-7bbd-4475-b3ae-99c8dce4aebc tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:45.991611 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-95a2f2d1-7bbd-4475-b3ae-99c8dce4aebc tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:45.992300 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-95a2f2d1-7bbd-4475-b3ae-99c8dce4aebc tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:45.993234 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-95a2f2d1-7bbd-4475-b3ae-99c8dce4aebc tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:45.993670 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-95a2f2d1-7bbd-4475-b3ae-99c8dce4aebc tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:46.037461 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ad068d6f-fd69-4af5-a862-2d4c35e9d610 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:46.040408 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ad068d6f-fd69-4af5-a862-2d4c35e9d610 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] [instance: 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:46.048603 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ad068d6f-fd69-4af5-a862-2d4c35e9d610 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:46.049089 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ad068d6f-fd69-4af5-a862-2d4c35e9d610 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:46.049939 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ad068d6f-fd69-4af5-a862-2d4c35e9d610 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:46.050584 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ad068d6f-fd69-4af5-a862-2d4c35e9d610 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:46.217147 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ad068d6f-fd69-4af5-a862-2d4c35e9d610 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2518c8b1d0146dcb93fd4e875389f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f826993a33644995a3150d71cc40add7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:46.232433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ad068d6f-fd69-4af5-a862-2d4c35e9d610 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3" status: 200 len: 1315 microversion: 2.1 time: 0.201417 Jun 29 12:35:46.242507 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 180/342] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:46 2022] GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:46.280765 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8e2af4c9-1840-4bc2-85de-e14eebdbb36c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:46.282085 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8e2af4c9-1840-4bc2-85de-e14eebdbb36c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:46.288255 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8e2af4c9-1840-4bc2-85de-e14eebdbb36c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:46.288810 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8e2af4c9-1840-4bc2-85de-e14eebdbb36c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:46.289657 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8e2af4c9-1840-4bc2-85de-e14eebdbb36c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:46.290187 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8e2af4c9-1840-4bc2-85de-e14eebdbb36c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:46.315199 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-95a2f2d1-7bbd-4475-b3ae-99c8dce4aebc tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:46.336932 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-95a2f2d1-7bbd-4475-b3ae-99c8dce4aebc tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1260 microversion: 2.1 time: 0.357308 Jun 29 12:35:46.347546 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 163/343] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:45 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1260 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:46.354491 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8e2af4c9-1840-4bc2-85de-e14eebdbb36c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:46.376159 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8e2af4c9-1840-4bc2-85de-e14eebdbb36c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1304 microversion: 2.1 time: 0.100280 Jun 29 12:35:46.377601 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 181/344] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:46 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:35:46.478655 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-96aa89a9-31e3-404e-bade-f6eaaeaed57d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:46.479280 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-96aa89a9-31e3-404e-bade-f6eaaeaed57d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:46.487028 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-96aa89a9-31e3-404e-bade-f6eaaeaed57d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:46.487972 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-96aa89a9-31e3-404e-bade-f6eaaeaed57d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:46.488987 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-96aa89a9-31e3-404e-bade-f6eaaeaed57d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:46.489436 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-96aa89a9-31e3-404e-bade-f6eaaeaed57d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:46.509049 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e8203e14-475e-42a7-9a54-5fe1ebd975d7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:46.509668 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e8203e14-475e-42a7-9a54-5fe1ebd975d7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:46.523892 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e8203e14-475e-42a7-9a54-5fe1ebd975d7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:46.524503 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e8203e14-475e-42a7-9a54-5fe1ebd975d7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:46.525361 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e8203e14-475e-42a7-9a54-5fe1ebd975d7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:46.525803 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e8203e14-475e-42a7-9a54-5fe1ebd975d7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:46.730104 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e8203e14-475e-42a7-9a54-5fe1ebd975d7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:46.739191 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e8203e14-475e-42a7-9a54-5fe1ebd975d7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:46.741852 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e8203e14-475e-42a7-9a54-5fe1ebd975d7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:46.743316 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e8203e14-475e-42a7-9a54-5fe1ebd975d7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1722 microversion: 2.20 time: 0.243184 Jun 29 12:35:46.744177 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 182/345] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:35:46 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:35:46.748759 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-58cb9d94-3886-48f4-ae44-f837639c88d4 req-94425a49-9552-407c-acff-b7228cf37dec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3", "name": "network-vif-plugged", "status": "completed", "tag": "1b7d5c23-5903-4ada-bbae-d0082028f2c4"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:35:46.759966 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-58cb9d94-3886-48f4-ae44-f837639c88d4 req-94425a49-9552-407c-acff-b7228cf37dec service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:46.760501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-58cb9d94-3886-48f4-ae44-f837639c88d4 req-94425a49-9552-407c-acff-b7228cf37dec service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:46.775816 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-58cb9d94-3886-48f4-ae44-f837639c88d4 req-94425a49-9552-407c-acff-b7228cf37dec service nova] Creating event network-vif-plugged:1b7d5c23-5903-4ada-bbae-d0082028f2c4 for instance 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 on hv-cinder-81268 Jun 29 12:35:46.783108 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-58cb9d94-3886-48f4-ae44-f837639c88d4 req-94425a49-9552-407c-acff-b7228cf37dec service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037693 Jun 29 12:35:46.783938 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 183/346] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:35:46.905895 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-96aa89a9-31e3-404e-bade-f6eaaeaed57d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:46.920764 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-96aa89a9-31e3-404e-bade-f6eaaeaed57d tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1702 microversion: 2.1 time: 0.446097 Jun 29 12:35:46.935740 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 164/347] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:46 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1702 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:46.940872 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-7c4819f3-af8d-44ed-a79b-ab76bc1ad700 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:35:46.949815 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7c4819f3-af8d-44ed-a79b-ab76bc1ad700 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:46.950547 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7c4819f3-af8d-44ed-a79b-ab76bc1ad700 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:47.028221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-7c4819f3-af8d-44ed-a79b-ab76bc1ad700 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Going to try to start instance {{(pid=124317) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 29 12:35:47.105512 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-7c4819f3-af8d-44ed-a79b-ab76bc1ad700 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "POST /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4/action" status: 202 len: 0 microversion: 2.1 time: 0.169214 Jun 29 12:35:47.107729 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 184/348] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 12:35:46 2022] POST /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 29 12:35:47.116210 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0b6422ec-e32a-4ab5-8fd6-2f7f30fc70c2 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:47.116825 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0b6422ec-e32a-4ab5-8fd6-2f7f30fc70c2 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:47.133026 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0b6422ec-e32a-4ab5-8fd6-2f7f30fc70c2 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:47.133518 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0b6422ec-e32a-4ab5-8fd6-2f7f30fc70c2 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:47.134318 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0b6422ec-e32a-4ab5-8fd6-2f7f30fc70c2 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:47.134780 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0b6422ec-e32a-4ab5-8fd6-2f7f30fc70c2 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:47.255391 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c9271b32-ed0e-4f65-b4a8-112188f274e6 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:47.256192 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c9271b32-ed0e-4f65-b4a8-112188f274e6 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] [instance: 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:47.263667 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c9271b32-ed0e-4f65-b4a8-112188f274e6 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:47.264457 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c9271b32-ed0e-4f65-b4a8-112188f274e6 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:47.265296 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c9271b32-ed0e-4f65-b4a8-112188f274e6 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:47.266406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c9271b32-ed0e-4f65-b4a8-112188f274e6 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:47.446638 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c9271b32-ed0e-4f65-b4a8-112188f274e6 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2518c8b1d0146dcb93fd4e875389f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f826993a33644995a3150d71cc40add7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:47.455012 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c9271b32-ed0e-4f65-b4a8-112188f274e6 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3" status: 200 len: 1315 microversion: 2.1 time: 0.204853 Jun 29 12:35:47.456119 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 185/349] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:47 2022] GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:47.460915 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-7ce7a44d-5686-4e30-9467-d92403a1a9ca tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:47.461683 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-7ce7a44d-5686-4e30-9467-d92403a1a9ca tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:47.469079 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7ce7a44d-5686-4e30-9467-d92403a1a9ca tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:47.469781 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7ce7a44d-5686-4e30-9467-d92403a1a9ca tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:47.470745 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7ce7a44d-5686-4e30-9467-d92403a1a9ca tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:47.471327 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7ce7a44d-5686-4e30-9467-d92403a1a9ca tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:47.476330 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:35:47.507371 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0b6422ec-e32a-4ab5-8fd6-2f7f30fc70c2 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:47.516332 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0b6422ec-e32a-4ab5-8fd6-2f7f30fc70c2 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1711 microversion: 2.1 time: 0.403640 Jun 29 12:35:47.517544 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 165/350] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:47 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1711 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:47.522792 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-385d9c25-2439-4529-8097-17f03b21317c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:47.523654 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-385d9c25-2439-4529-8097-17f03b21317c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:47.529893 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-385d9c25-2439-4529-8097-17f03b21317c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:47.530555 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-385d9c25-2439-4529-8097-17f03b21317c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:47.531572 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-385d9c25-2439-4529-8097-17f03b21317c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:47.532193 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-385d9c25-2439-4529-8097-17f03b21317c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:47.700960 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7ce7a44d-5686-4e30-9467-d92403a1a9ca tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:47.709551 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-7ce7a44d-5686-4e30-9467-d92403a1a9ca tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1260 microversion: 2.1 time: 0.251871 Jun 29 12:35:47.719612 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 186/351] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:47 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1260 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:47.725303 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-c241f6b3-7075-4d3a-8bba-e8a8fc9aca79 req-b28e39d4-7b7a-42ef-b675-31ebeb995053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72186d8a-10a4-4b4a-b57e-6e8e520dc784", "tag": "32283955-f720-4723-80b6-82d0fc44730d"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:35:47.734128 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-c241f6b3-7075-4d3a-8bba-e8a8fc9aca79 req-b28e39d4-7b7a-42ef-b675-31ebeb995053 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:47.734663 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-c241f6b3-7075-4d3a-8bba-e8a8fc9aca79 req-b28e39d4-7b7a-42ef-b675-31ebeb995053 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:47.748741 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-c241f6b3-7075-4d3a-8bba-e8a8fc9aca79 req-b28e39d4-7b7a-42ef-b675-31ebeb995053 service nova] Creating event network-changed:32283955-f720-4723-80b6-82d0fc44730d for instance 72186d8a-10a4-4b4a-b57e-6e8e520dc784 on hv-cinder-81268 Jun 29 12:35:47.754406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-c241f6b3-7075-4d3a-8bba-e8a8fc9aca79 req-b28e39d4-7b7a-42ef-b675-31ebeb995053 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033246 Jun 29 12:35:47.755242 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 187/352] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:35:47.764760 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-65b46bdb-df80-4222-90a8-4a40822d56a2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:47.766025 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-65b46bdb-df80-4222-90a8-4a40822d56a2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:47.773159 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-65b46bdb-df80-4222-90a8-4a40822d56a2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:47.773839 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-65b46bdb-df80-4222-90a8-4a40822d56a2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:47.774890 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-65b46bdb-df80-4222-90a8-4a40822d56a2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:47.778533 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-65b46bdb-df80-4222-90a8-4a40822d56a2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:47.845010 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-385d9c25-2439-4529-8097-17f03b21317c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:47.858925 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-385d9c25-2439-4529-8097-17f03b21317c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1372 microversion: 2.1 time: 0.339959 Jun 29 12:35:47.860394 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 166/353] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:47 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1372 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:48.063412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-65b46bdb-df80-4222-90a8-4a40822d56a2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:48.072549 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-65b46bdb-df80-4222-90a8-4a40822d56a2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:48.077726 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-65b46bdb-df80-4222-90a8-4a40822d56a2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:48.079035 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-65b46bdb-df80-4222-90a8-4a40822d56a2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1722 microversion: 2.20 time: 0.318951 Jun 29 12:35:48.079906 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 188/354] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:35:47 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1722 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:35:48.480365 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f595608d-7616-4492-8340-b03b9c0a279c tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:48.480887 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f595608d-7616-4492-8340-b03b9c0a279c tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] [instance: 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:48.488001 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f595608d-7616-4492-8340-b03b9c0a279c tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:48.488351 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f595608d-7616-4492-8340-b03b9c0a279c tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:48.489119 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f595608d-7616-4492-8340-b03b9c0a279c tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:48.489722 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f595608d-7616-4492-8340-b03b9c0a279c tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:48.535291 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0fb0430b-920d-49fd-9091-736559259c60 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:48.535901 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0fb0430b-920d-49fd-9091-736559259c60 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:48.543776 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0fb0430b-920d-49fd-9091-736559259c60 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:48.544220 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0fb0430b-920d-49fd-9091-736559259c60 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:48.550465 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0fb0430b-920d-49fd-9091-736559259c60 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:48.550465 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0fb0430b-920d-49fd-9091-736559259c60 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:48.684357 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f595608d-7616-4492-8340-b03b9c0a279c tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2518c8b1d0146dcb93fd4e875389f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f826993a33644995a3150d71cc40add7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:48.692615 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f595608d-7616-4492-8340-b03b9c0a279c tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3" status: 200 len: 1315 microversion: 2.1 time: 0.216171 Jun 29 12:35:48.693202 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 167/355] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:48 2022] GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:48.703169 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0fb0430b-920d-49fd-9091-736559259c60 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:48.711063 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0fb0430b-920d-49fd-9091-736559259c60 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1711 microversion: 2.1 time: 0.180852 Jun 29 12:35:48.711609 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 189/356] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:48 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1711 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:48.725454 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8e5c9ec8-7cf2-4635-8151-60f64f94267d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:48.726075 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8e5c9ec8-7cf2-4635-8151-60f64f94267d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:48.732278 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8e5c9ec8-7cf2-4635-8151-60f64f94267d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:48.732665 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8e5c9ec8-7cf2-4635-8151-60f64f94267d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:48.733591 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8e5c9ec8-7cf2-4635-8151-60f64f94267d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:48.734054 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8e5c9ec8-7cf2-4635-8151-60f64f94267d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:48.739787 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=100 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:35:48.877388 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e6dbece7-b574-46ef-b1d4-a42fba9a89cc tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:48.877975 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e6dbece7-b574-46ef-b1d4-a42fba9a89cc tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:48.880894 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8e5c9ec8-7cf2-4635-8151-60f64f94267d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:48.884316 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e6dbece7-b574-46ef-b1d4-a42fba9a89cc tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:48.884873 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e6dbece7-b574-46ef-b1d4-a42fba9a89cc tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:48.885784 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e6dbece7-b574-46ef-b1d4-a42fba9a89cc tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:48.893273 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8e5c9ec8-7cf2-4635-8151-60f64f94267d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1260 microversion: 2.1 time: 0.171579 Jun 29 12:35:48.894641 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 168/357] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:48 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:48.896394 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e6dbece7-b574-46ef-b1d4-a42fba9a89cc tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:49.087218 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e6dbece7-b574-46ef-b1d4-a42fba9a89cc tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:49.095668 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e6dbece7-b574-46ef-b1d4-a42fba9a89cc tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1372 microversion: 2.1 time: 0.222445 Jun 29 12:35:49.096236 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 190/358] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:48 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1372 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:49.100272 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-dfa14109-fc8f-431e-9603-dc1e66749f2a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:49.101010 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-dfa14109-fc8f-431e-9603-dc1e66749f2a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:49.107575 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-dfa14109-fc8f-431e-9603-dc1e66749f2a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:49.108077 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-dfa14109-fc8f-431e-9603-dc1e66749f2a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:49.108918 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-dfa14109-fc8f-431e-9603-dc1e66749f2a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:49.109896 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-dfa14109-fc8f-431e-9603-dc1e66749f2a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:49.239229 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-dfa14109-fc8f-431e-9603-dc1e66749f2a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:49.247689 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-dfa14109-fc8f-431e-9603-dc1e66749f2a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:49.249229 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-dfa14109-fc8f-431e-9603-dc1e66749f2a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:49.250979 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-dfa14109-fc8f-431e-9603-dc1e66749f2a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1722 microversion: 2.20 time: 0.157707 Jun 29 12:35:49.251538 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 169/359] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:35:49 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:35:49.709065 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d0461ada-79df-4587-9a15-345b6ab7daad tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:49.709670 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d0461ada-79df-4587-9a15-345b6ab7daad tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] [instance: 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:49.715541 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d0461ada-79df-4587-9a15-345b6ab7daad tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:49.715991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d0461ada-79df-4587-9a15-345b6ab7daad tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:49.716748 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d0461ada-79df-4587-9a15-345b6ab7daad tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:49.717177 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d0461ada-79df-4587-9a15-345b6ab7daad tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:49.728683 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-44e4c814-6b20-43c2-8aed-7607b97c59fc tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:49.729296 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-44e4c814-6b20-43c2-8aed-7607b97c59fc tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:49.736879 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-44e4c814-6b20-43c2-8aed-7607b97c59fc tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:49.737328 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-44e4c814-6b20-43c2-8aed-7607b97c59fc tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:49.738147 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-44e4c814-6b20-43c2-8aed-7607b97c59fc tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:49.738608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-44e4c814-6b20-43c2-8aed-7607b97c59fc tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:49.862080 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d0461ada-79df-4587-9a15-345b6ab7daad tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2518c8b1d0146dcb93fd4e875389f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f826993a33644995a3150d71cc40add7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:49.869973 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d0461ada-79df-4587-9a15-345b6ab7daad tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3" status: 200 len: 1464 microversion: 2.1 time: 0.164780 Jun 29 12:35:49.870557 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 191/360] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:49 2022] GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 => generated 1464 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:49.875198 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-d23fb2bd-fe2b-4aa5-9bdd-1fe1c42ec185 req-0af71d36-6a17-4c11-a8af-1a851c569d37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44f2e3f4-c3b9-44d5-9648-2a68acec3d2c", "tag": "e0d184c2-5cac-4f0e-a86b-473ab610d153"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:35:49.876483 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-44e4c814-6b20-43c2-8aed-7607b97c59fc tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:49.883720 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-d23fb2bd-fe2b-4aa5-9bdd-1fe1c42ec185 req-0af71d36-6a17-4c11-a8af-1a851c569d37 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:49.884427 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-d23fb2bd-fe2b-4aa5-9bdd-1fe1c42ec185 req-0af71d36-6a17-4c11-a8af-1a851c569d37 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:49.885437 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-44e4c814-6b20-43c2-8aed-7607b97c59fc tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1711 microversion: 2.1 time: 0.160669 Jun 29 12:35:49.886220 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 170/361] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:49 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1711 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:35:49.898252 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-d23fb2bd-fe2b-4aa5-9bdd-1fe1c42ec185 req-0af71d36-6a17-4c11-a8af-1a851c569d37 service nova] Creating event network-changed:e0d184c2-5cac-4f0e-a86b-473ab610d153 for instance 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c on hv-cinder-81268 Jun 29 12:35:49.902959 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-d23fb2bd-fe2b-4aa5-9bdd-1fe1c42ec185 req-0af71d36-6a17-4c11-a8af-1a851c569d37 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031254 Jun 29 12:35:49.903522 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 192/362] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:35:49.911892 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-93414eb5-0118-4da1-806c-32c2def428d0 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:49.912456 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-93414eb5-0118-4da1-806c-32c2def428d0 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] [instance: 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:49.912827 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-cfbafbf6-4663-4e52-83bd-e8e56361c95e tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:49.913581 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-cfbafbf6-4663-4e52-83bd-e8e56361c95e tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:49.918513 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-93414eb5-0118-4da1-806c-32c2def428d0 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:49.918963 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-93414eb5-0118-4da1-806c-32c2def428d0 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:49.919644 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cfbafbf6-4663-4e52-83bd-e8e56361c95e tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:49.919742 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-93414eb5-0118-4da1-806c-32c2def428d0 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:49.920080 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cfbafbf6-4663-4e52-83bd-e8e56361c95e tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:49.920197 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-93414eb5-0118-4da1-806c-32c2def428d0 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:49.920818 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cfbafbf6-4663-4e52-83bd-e8e56361c95e tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:49.921243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cfbafbf6-4663-4e52-83bd-e8e56361c95e tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:49.944172 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-93414eb5-0118-4da1-806c-32c2def428d0 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] [instance: 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 12:35:50.044318 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-93414eb5-0118-4da1-806c-32c2def428d0 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3" status: 204 len: 0 microversion: 2.1 time: 0.135919 Jun 29 12:35:50.046507 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 171/363] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:35:49 2022] DELETE /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 12:35:50.056006 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6f09feda-2e9a-4c23-9f99-fe389f3b8619 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:50.056579 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6f09feda-2e9a-4c23-9f99-fe389f3b8619 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] [instance: 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:50.063418 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-cfbafbf6-4663-4e52-83bd-e8e56361c95e tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:50.069700 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6f09feda-2e9a-4c23-9f99-fe389f3b8619 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:50.070271 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6f09feda-2e9a-4c23-9f99-fe389f3b8619 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:50.071089 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6f09feda-2e9a-4c23-9f99-fe389f3b8619 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:50.071467 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-cfbafbf6-4663-4e52-83bd-e8e56361c95e tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1260 microversion: 2.1 time: 0.162556 Jun 29 12:35:50.071589 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6f09feda-2e9a-4c23-9f99-fe389f3b8619 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:50.072204 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 193/364] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:49 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:35:50.112478 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-462bfb36-4961-4752-8667-c0e7eb08f057 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:50.113327 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-462bfb36-4961-4752-8667-c0e7eb08f057 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:50.125991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-462bfb36-4961-4752-8667-c0e7eb08f057 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:50.126813 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-462bfb36-4961-4752-8667-c0e7eb08f057 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:50.128158 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-462bfb36-4961-4752-8667-c0e7eb08f057 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:50.128924 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-462bfb36-4961-4752-8667-c0e7eb08f057 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:50.209192 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6f09feda-2e9a-4c23-9f99-fe389f3b8619 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2518c8b1d0146dcb93fd4e875389f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f826993a33644995a3150d71cc40add7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:50.231647 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6f09feda-2e9a-4c23-9f99-fe389f3b8619 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3" status: 200 len: 1470 microversion: 2.1 time: 0.180037 Jun 29 12:35:50.236112 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 172/365] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:50 2022] GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 => generated 1470 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:50.272069 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8124668f-14b2-4b00-a87c-682a61f7ebbd tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:50.272999 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8124668f-14b2-4b00-a87c-682a61f7ebbd tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:50.283374 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-462bfb36-4961-4752-8667-c0e7eb08f057 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:50.284677 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8124668f-14b2-4b00-a87c-682a61f7ebbd tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:50.285260 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8124668f-14b2-4b00-a87c-682a61f7ebbd tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:50.286151 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8124668f-14b2-4b00-a87c-682a61f7ebbd tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:50.287214 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8124668f-14b2-4b00-a87c-682a61f7ebbd tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:50.294594 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-462bfb36-4961-4752-8667-c0e7eb08f057 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1372 microversion: 2.1 time: 0.186709 Jun 29 12:35:50.295174 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 194/366] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:50 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1372 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:35:50.487287 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8124668f-14b2-4b00-a87c-682a61f7ebbd tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:50.495182 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8124668f-14b2-4b00-a87c-682a61f7ebbd tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:50.496957 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8124668f-14b2-4b00-a87c-682a61f7ebbd tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:50.498093 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8124668f-14b2-4b00-a87c-682a61f7ebbd tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1722 microversion: 2.20 time: 0.231962 Jun 29 12:35:50.498674 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 173/367] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:35:50 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:35:50.903544 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b6824083-b83c-4c6a-8933-145a19ca19ae tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:50.904155 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b6824083-b83c-4c6a-8933-145a19ca19ae tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:50.910870 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b6824083-b83c-4c6a-8933-145a19ca19ae tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:50.911323 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b6824083-b83c-4c6a-8933-145a19ca19ae tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:50.912082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b6824083-b83c-4c6a-8933-145a19ca19ae tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:50.912522 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b6824083-b83c-4c6a-8933-145a19ca19ae tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:51.041581 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b6824083-b83c-4c6a-8933-145a19ca19ae tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:51.049998 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b6824083-b83c-4c6a-8933-145a19ca19ae tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1715 microversion: 2.1 time: 0.150351 Jun 29 12:35:51.050576 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 195/368] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:50 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1715 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:51.088270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-bf8da731-69f6-41df-89b2-724506aef2c5 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:51.088878 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-bf8da731-69f6-41df-89b2-724506aef2c5 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:51.095719 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bf8da731-69f6-41df-89b2-724506aef2c5 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:51.096162 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bf8da731-69f6-41df-89b2-724506aef2c5 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:51.096918 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bf8da731-69f6-41df-89b2-724506aef2c5 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:51.097346 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bf8da731-69f6-41df-89b2-724506aef2c5 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:51.226226 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-bf8da731-69f6-41df-89b2-724506aef2c5 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:51.233610 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-bf8da731-69f6-41df-89b2-724506aef2c5 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1260 microversion: 2.1 time: 0.149045 Jun 29 12:35:51.234234 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 174/369] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:51 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:51.250725 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e733b8ae-a546-48e5-9e13-29cc3aa1459d tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:51.251329 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e733b8ae-a546-48e5-9e13-29cc3aa1459d tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] [instance: 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:51.257310 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e733b8ae-a546-48e5-9e13-29cc3aa1459d tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:51.257754 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e733b8ae-a546-48e5-9e13-29cc3aa1459d tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:51.258551 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e733b8ae-a546-48e5-9e13-29cc3aa1459d tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:51.258995 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e733b8ae-a546-48e5-9e13-29cc3aa1459d tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:51.311440 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e56b2e3d-5923-4ff4-8882-fc1b2919f226 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:51.312042 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e56b2e3d-5923-4ff4-8882-fc1b2919f226 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:51.318216 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e56b2e3d-5923-4ff4-8882-fc1b2919f226 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:51.318696 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e56b2e3d-5923-4ff4-8882-fc1b2919f226 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:51.319449 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e56b2e3d-5923-4ff4-8882-fc1b2919f226 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:51.319883 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e56b2e3d-5923-4ff4-8882-fc1b2919f226 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:51.389858 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e733b8ae-a546-48e5-9e13-29cc3aa1459d tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2518c8b1d0146dcb93fd4e875389f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f826993a33644995a3150d71cc40add7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:51.398079 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e733b8ae-a546-48e5-9e13-29cc3aa1459d tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3" status: 200 len: 1470 microversion: 2.1 time: 0.151352 Jun 29 12:35:51.398668 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 196/370] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:51 2022] GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:51.448233 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e56b2e3d-5923-4ff4-8882-fc1b2919f226 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:51.456408 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e56b2e3d-5923-4ff4-8882-fc1b2919f226 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1372 microversion: 2.1 time: 0.148873 Jun 29 12:35:51.456970 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 175/371] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:51 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:35:51.517595 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ba56350b-3ad1-4690-a7a7-e18367c24542 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:51.518192 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ba56350b-3ad1-4690-a7a7-e18367c24542 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:51.524382 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ba56350b-3ad1-4690-a7a7-e18367c24542 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:51.524822 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ba56350b-3ad1-4690-a7a7-e18367c24542 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:51.525565 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ba56350b-3ad1-4690-a7a7-e18367c24542 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:51.525992 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ba56350b-3ad1-4690-a7a7-e18367c24542 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:51.662466 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ba56350b-3ad1-4690-a7a7-e18367c24542 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:51.670314 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ba56350b-3ad1-4690-a7a7-e18367c24542 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:51.671956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ba56350b-3ad1-4690-a7a7-e18367c24542 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:51.673153 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ba56350b-3ad1-4690-a7a7-e18367c24542 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1722 microversion: 2.20 time: 0.160303 Jun 29 12:35:51.673708 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 197/372] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:35:51 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:35:52.250785 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4ebcbf4a-830c-4b03-9f3e-8e28fd8c44d3 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:52.251397 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4ebcbf4a-830c-4b03-9f3e-8e28fd8c44d3 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:52.257817 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4ebcbf4a-830c-4b03-9f3e-8e28fd8c44d3 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:52.258266 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4ebcbf4a-830c-4b03-9f3e-8e28fd8c44d3 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:52.259052 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4ebcbf4a-830c-4b03-9f3e-8e28fd8c44d3 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:52.259496 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4ebcbf4a-830c-4b03-9f3e-8e28fd8c44d3 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:52.392635 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4ebcbf4a-830c-4b03-9f3e-8e28fd8c44d3 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:52.400256 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4ebcbf4a-830c-4b03-9f3e-8e28fd8c44d3 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1260 microversion: 2.1 time: 0.153550 Jun 29 12:35:52.400812 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 176/373] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:52 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:52.415695 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-38df22b3-fc25-4692-abdd-66e3fa2b9742 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:52.416296 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-38df22b3-fc25-4692-abdd-66e3fa2b9742 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] [instance: 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:52.422546 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-38df22b3-fc25-4692-abdd-66e3fa2b9742 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:52.422991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-38df22b3-fc25-4692-abdd-66e3fa2b9742 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:52.423736 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-38df22b3-fc25-4692-abdd-66e3fa2b9742 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:52.424164 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-38df22b3-fc25-4692-abdd-66e3fa2b9742 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:52.473340 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-04605d40-8764-4c6e-8cef-578e9e47be24 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:52.473951 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-04605d40-8764-4c6e-8cef-578e9e47be24 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:52.480451 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-04605d40-8764-4c6e-8cef-578e9e47be24 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:52.480911 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-04605d40-8764-4c6e-8cef-578e9e47be24 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:52.481676 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-04605d40-8764-4c6e-8cef-578e9e47be24 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:52.482115 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-04605d40-8764-4c6e-8cef-578e9e47be24 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:52.552850 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-38df22b3-fc25-4692-abdd-66e3fa2b9742 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2518c8b1d0146dcb93fd4e875389f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f826993a33644995a3150d71cc40add7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:52.560541 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-38df22b3-fc25-4692-abdd-66e3fa2b9742 tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3" status: 200 len: 1470 microversion: 2.1 time: 0.148575 Jun 29 12:35:52.561098 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 198/374] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:52 2022] GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:52.612216 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-04605d40-8764-4c6e-8cef-578e9e47be24 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:52.619692 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-04605d40-8764-4c6e-8cef-578e9e47be24 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1372 microversion: 2.1 time: 0.150568 Jun 29 12:35:52.620253 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 177/375] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:52 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:35:52.690904 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-22218d05-7431-41f1-be41-9db480d4f007 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:52.691446 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-22218d05-7431-41f1-be41-9db480d4f007 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:52.697334 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-22218d05-7431-41f1-be41-9db480d4f007 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:52.697773 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-22218d05-7431-41f1-be41-9db480d4f007 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:52.698540 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-22218d05-7431-41f1-be41-9db480d4f007 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:52.698974 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-22218d05-7431-41f1-be41-9db480d4f007 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:52.830705 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-22218d05-7431-41f1-be41-9db480d4f007 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:52.838452 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-22218d05-7431-41f1-be41-9db480d4f007 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:52.839931 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-22218d05-7431-41f1-be41-9db480d4f007 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:52.841068 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-22218d05-7431-41f1-be41-9db480d4f007 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1722 microversion: 2.20 time: 0.154431 Jun 29 12:35:52.841618 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 199/376] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:35:52 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:35:53.416464 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-82fd7379-194b-4927-bca8-0c108f21242c tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:53.417228 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-82fd7379-194b-4927-bca8-0c108f21242c tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:53.425349 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-82fd7379-194b-4927-bca8-0c108f21242c tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:53.425801 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-82fd7379-194b-4927-bca8-0c108f21242c tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:53.426713 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-82fd7379-194b-4927-bca8-0c108f21242c tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:53.427225 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-82fd7379-194b-4927-bca8-0c108f21242c tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:53.577072 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ac36e787-b172-47ef-a4b4-e59e0d615ffe tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:53.577683 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ac36e787-b172-47ef-a4b4-e59e0d615ffe tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] [instance: 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:53.579974 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=4 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:35:53.580673 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=16 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:35:53.586371 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ac36e787-b172-47ef-a4b4-e59e0d615ffe tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:53.586862 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ac36e787-b172-47ef-a4b4-e59e0d615ffe tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:53.587630 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ac36e787-b172-47ef-a4b4-e59e0d615ffe tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:53.588076 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ac36e787-b172-47ef-a4b4-e59e0d615ffe tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:53.616654 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-82fd7379-194b-4927-bca8-0c108f21242c tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:53.624277 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-82fd7379-194b-4927-bca8-0c108f21242c tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1260 microversion: 2.1 time: 0.211702 Jun 29 12:35:53.625544 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 178/377] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:53 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1260 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:53.647541 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8fa83099-9e40-4e2a-a2bc-41ddc4853256 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:53.648162 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8fa83099-9e40-4e2a-a2bc-41ddc4853256 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:53.654189 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8fa83099-9e40-4e2a-a2bc-41ddc4853256 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:53.654723 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8fa83099-9e40-4e2a-a2bc-41ddc4853256 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:53.655561 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8fa83099-9e40-4e2a-a2bc-41ddc4853256 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:53.656028 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8fa83099-9e40-4e2a-a2bc-41ddc4853256 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:53.749012 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ac36e787-b172-47ef-a4b4-e59e0d615ffe tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2518c8b1d0146dcb93fd4e875389f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f826993a33644995a3150d71cc40add7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:53.758591 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ac36e787-b172-47ef-a4b4-e59e0d615ffe tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3" status: 200 len: 1470 microversion: 2.1 time: 0.185369 Jun 29 12:35:53.759176 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 200/378] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:53 2022] GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 => generated 1470 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:35:53.860168 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:35:53.861954 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f758c2ae-4ebf-403f-b419-73a476a4b154 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:53.862780 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f758c2ae-4ebf-403f-b419-73a476a4b154 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:53.870002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f758c2ae-4ebf-403f-b419-73a476a4b154 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:53.872936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f758c2ae-4ebf-403f-b419-73a476a4b154 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:53.873771 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f758c2ae-4ebf-403f-b419-73a476a4b154 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:53.874219 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f758c2ae-4ebf-403f-b419-73a476a4b154 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:53.950300 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8fa83099-9e40-4e2a-a2bc-41ddc4853256 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:53.959964 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8fa83099-9e40-4e2a-a2bc-41ddc4853256 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1372 microversion: 2.1 time: 0.316255 Jun 29 12:35:53.961172 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 179/379] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:53 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1372 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:53.966557 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-3e7852c1-288f-40b7-b662-233bc202e3a5 req-b6c3393d-724e-43c1-8109-36709d8c2eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3", "name": "network-vif-deleted", "tag": "1b7d5c23-5903-4ada-bbae-d0082028f2c4"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:35:53.998657 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-3e7852c1-288f-40b7-b662-233bc202e3a5 req-b6c3393d-724e-43c1-8109-36709d8c2eed service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:54.000639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-3e7852c1-288f-40b7-b662-233bc202e3a5 req-b6c3393d-724e-43c1-8109-36709d8c2eed service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:54.024554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-3e7852c1-288f-40b7-b662-233bc202e3a5 req-b6c3393d-724e-43c1-8109-36709d8c2eed service nova] Creating event network-vif-deleted:1b7d5c23-5903-4ada-bbae-d0082028f2c4 for instance 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 on hv-cinder-81268 Jun 29 12:35:54.031776 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-3e7852c1-288f-40b7-b662-233bc202e3a5 req-b6c3393d-724e-43c1-8109-36709d8c2eed service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068674 Jun 29 12:35:54.032692 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 180/380] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:35:54.052718 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f758c2ae-4ebf-403f-b419-73a476a4b154 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:54.063493 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f758c2ae-4ebf-403f-b419-73a476a4b154 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:54.064388 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f758c2ae-4ebf-403f-b419-73a476a4b154 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:54.065976 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f758c2ae-4ebf-403f-b419-73a476a4b154 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1722 microversion: 2.20 time: 0.209994 Jun 29 12:35:54.066625 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 201/381] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:35:53 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:35:54.638337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=12 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:35:54.643360 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-706b1675-6291-4d41-bc03-55147cfd8902 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:54.644497 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-706b1675-6291-4d41-bc03-55147cfd8902 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:54.651481 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-706b1675-6291-4d41-bc03-55147cfd8902 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:54.651928 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-706b1675-6291-4d41-bc03-55147cfd8902 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:54.652697 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-706b1675-6291-4d41-bc03-55147cfd8902 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:54.653134 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-706b1675-6291-4d41-bc03-55147cfd8902 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:54.777084 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-aaa71733-ca29-4b09-a807-88e0ab10d42d tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:54.778148 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-aaa71733-ca29-4b09-a807-88e0ab10d42d tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] [instance: 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:54.785632 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aaa71733-ca29-4b09-a807-88e0ab10d42d tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:54.786084 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aaa71733-ca29-4b09-a807-88e0ab10d42d tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:54.786881 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aaa71733-ca29-4b09-a807-88e0ab10d42d tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:54.787318 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aaa71733-ca29-4b09-a807-88e0ab10d42d tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:54.789635 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-706b1675-6291-4d41-bc03-55147cfd8902 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:54.797651 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-706b1675-6291-4d41-bc03-55147cfd8902 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1260 microversion: 2.1 time: 0.160323 Jun 29 12:35:54.798522 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 181/382] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:54 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:54.801629 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-aaa71733-ca29-4b09-a807-88e0ab10d42d tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] HTTP exception thrown: Instance 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 could not be found. Jun 29 12:35:54.803468 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-aaa71733-ca29-4b09-a807-88e0ab10d42d tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Request method failure captured: Jun 29 12:35:54.803468 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 HTTP/1.1 Jun 29 12:35:54.803468 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:35:54.803468 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:35:54.803468 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:35:54.803468 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:35:54.803468 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:35:54.803468 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:35:54.803468 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:35:54.803468 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:35:54.803468 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEcW7ikBzKRoVz03OIkeGmfcTCjO2YOCuPhLIA9O2QmWCe4-QpxGy4qhWUWDc1PFWFcRF3AiQHFYUlf_nqm88CpnnISWuaDoQEhUVBjw1QPTQ-Jq5HftJIVAlbiTQpLMJXp6lGrab3dsXqIR1FtY8gSU42Z96Z9hJFzJDf6oMHixn4c Jun 29 12:35:54.803468 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:35:54.803468 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:35:54.803468 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:35:54.803468 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:35:54.803468 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:35:54.803468 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:35:54.803468 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: f826993a33644995a3150d71cc40add7 Jun 29 12:35:54.803468 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-VolumesNegativeTest-33388392 Jun 29 12:35:54.803468 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:35:54.803468 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:35:54.806233 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f826993a33644995a3150d71cc40add7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f826993a33644995a3150d71cc40add7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f826993a33644995a3150d71cc40add7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f826993a33644995a3150d71cc40add7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:35:54.806233 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-VolumesNegativeTest-33388392 Jun 29 12:35:54.806233 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: f826993a33644995a3150d71cc40add7 Jun 29 12:35:54.806233 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-VolumesNegativeTest-33388392 Jun 29 12:35:54.806233 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-VolumesNegativeTest-33388392-project Jun 29 12:35:54.806233 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:35:54.806233 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:35:54.806233 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: c2518c8b1d0146dcb93fd4e875389f66 Jun 29 12:35:54.806233 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-VolumesNegativeTest-33388392-project Jun 29 12:35:54.806233 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:35:54.806233 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Instance 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 could not be found. Jun 29 12:35:54.806233 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': '2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3'} Jun 29 12:35:54.807873 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:35:54.807873 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:35:54.807873 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:35:54.807873 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:35:54.807873 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:35:54.807873 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:35:54.807873 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:35:54.807873 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:35:54.807873 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:35:54.807873 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:35:54.807873 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 could not be found. Jun 29 12:35:54.807873 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:35:54.807873 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:35:54.807873 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:35:54.807873 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:35:54.807873 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:35:54.807873 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:35:54.807873 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:35:54.807873 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:35:54.807873 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:35:54.810273 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:35:54.810273 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:35:54.810273 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:35:54.810273 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:35:54.810273 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:35:54.810273 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:35:54.810273 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:35:54.810273 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 could not be found. Jun 29 12:35:54.810273 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:35:54.810273 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:35:54.810273 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:35:54.810273 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:35:54.810273 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:35:54.810273 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:35:54.810273 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:35:54.810273 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:35:54.810273 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 could not be found. Jun 29 12:35:54.810273 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:35:54.812975 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-aaa71733-ca29-4b09-a807-88e0ab10d42d tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] Returning 404 to user: Instance 2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:35:54.812975 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-aaa71733-ca29-4b09-a807-88e0ab10d42d tempest-VolumesNegativeTest-33388392 tempest-VolumesNegativeTest-33388392-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3" status: 404 len: 111 microversion: 2.1 time: 0.032480 Jun 29 12:35:54.812975 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 202/383] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:54 2022] GET /compute/v2.1/servers/2e1fb1db-cfe3-46c8-9f3a-c3c28b4527e3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 12:35:54.977941 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-188674a1-bd2d-4785-b1d1-4acf90c9a029 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:54.978733 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-188674a1-bd2d-4785-b1d1-4acf90c9a029 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:54.984982 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-188674a1-bd2d-4785-b1d1-4acf90c9a029 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:54.985638 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-188674a1-bd2d-4785-b1d1-4acf90c9a029 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:54.986401 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-188674a1-bd2d-4785-b1d1-4acf90c9a029 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:54.987018 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-188674a1-bd2d-4785-b1d1-4acf90c9a029 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:55.086329 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-60b4ff6a-ee3b-4473-adf3-a0bdad391557 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:55.087400 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-60b4ff6a-ee3b-4473-adf3-a0bdad391557 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:55.093575 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-60b4ff6a-ee3b-4473-adf3-a0bdad391557 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:55.094218 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-60b4ff6a-ee3b-4473-adf3-a0bdad391557 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:55.095189 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-60b4ff6a-ee3b-4473-adf3-a0bdad391557 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:55.095626 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-60b4ff6a-ee3b-4473-adf3-a0bdad391557 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:55.133564 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-188674a1-bd2d-4785-b1d1-4acf90c9a029 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:55.141528 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-188674a1-bd2d-4785-b1d1-4acf90c9a029 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1372 microversion: 2.1 time: 0.167658 Jun 29 12:35:55.142565 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 182/384] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:54 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:55.238238 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-60b4ff6a-ee3b-4473-adf3-a0bdad391557 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:55.250122 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-60b4ff6a-ee3b-4473-adf3-a0bdad391557 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:55.252282 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-60b4ff6a-ee3b-4473-adf3-a0bdad391557 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:55.253468 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-60b4ff6a-ee3b-4473-adf3-a0bdad391557 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1743 microversion: 2.20 time: 0.171137 Jun 29 12:35:55.254018 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 203/385] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:35:55 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:35:55.818515 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-61ae9142-0e7a-4b0f-906c-9b963617d22d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:55.819134 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-61ae9142-0e7a-4b0f-906c-9b963617d22d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:55.825607 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-61ae9142-0e7a-4b0f-906c-9b963617d22d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:55.825991 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-61ae9142-0e7a-4b0f-906c-9b963617d22d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:55.826857 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-61ae9142-0e7a-4b0f-906c-9b963617d22d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:55.827219 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-61ae9142-0e7a-4b0f-906c-9b963617d22d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:55.972687 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-61ae9142-0e7a-4b0f-906c-9b963617d22d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:55.976116 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:35:55.980510 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-61ae9142-0e7a-4b0f-906c-9b963617d22d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1260 microversion: 2.1 time: 0.165843 Jun 29 12:35:55.981069 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 183/386] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:55 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:56.159252 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-58da9b74-08f4-41b1-8852-596f939b47ba tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:56.159857 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-58da9b74-08f4-41b1-8852-596f939b47ba tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:56.166014 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-58da9b74-08f4-41b1-8852-596f939b47ba tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:56.166481 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-58da9b74-08f4-41b1-8852-596f939b47ba tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:56.167240 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-58da9b74-08f4-41b1-8852-596f939b47ba tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:56.167665 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-58da9b74-08f4-41b1-8852-596f939b47ba tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:56.273527 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c906bef2-8d75-4f46-891a-fe489704f789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:56.274127 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c906bef2-8d75-4f46-891a-fe489704f789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:56.282774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c906bef2-8d75-4f46-891a-fe489704f789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:56.283224 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c906bef2-8d75-4f46-891a-fe489704f789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:56.283985 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c906bef2-8d75-4f46-891a-fe489704f789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:56.284417 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c906bef2-8d75-4f46-891a-fe489704f789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:56.310735 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-58da9b74-08f4-41b1-8852-596f939b47ba tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:56.314732 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=100 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:35:56.319503 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-58da9b74-08f4-41b1-8852-596f939b47ba tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1372 microversion: 2.1 time: 0.164424 Jun 29 12:35:56.326340 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 204/387] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:56 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:56.437198 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c906bef2-8d75-4f46-891a-fe489704f789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:56.445693 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c906bef2-8d75-4f46-891a-fe489704f789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:56.447317 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c906bef2-8d75-4f46-891a-fe489704f789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:56.448534 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c906bef2-8d75-4f46-891a-fe489704f789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1743 microversion: 2.20 time: 0.179102 Jun 29 12:35:56.449169 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 184/388] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:35:56 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1743 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:35:56.996797 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-37ea3188-c394-40cd-ba0d-d79970727d50 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:56.997539 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-37ea3188-c394-40cd-ba0d-d79970727d50 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:57.004381 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-37ea3188-c394-40cd-ba0d-d79970727d50 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:57.004822 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-37ea3188-c394-40cd-ba0d-d79970727d50 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:57.006207 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-37ea3188-c394-40cd-ba0d-d79970727d50 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:57.006678 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-37ea3188-c394-40cd-ba0d-d79970727d50 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:57.142741 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-37ea3188-c394-40cd-ba0d-d79970727d50 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:57.150416 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-37ea3188-c394-40cd-ba0d-d79970727d50 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1260 microversion: 2.1 time: 0.157374 Jun 29 12:35:57.151002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 205/389] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:56 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:57.343097 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3eb9275f-f270-4cd7-8c6f-063165910218 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:57.344935 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3eb9275f-f270-4cd7-8c6f-063165910218 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:57.351515 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3eb9275f-f270-4cd7-8c6f-063165910218 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:57.351974 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3eb9275f-f270-4cd7-8c6f-063165910218 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:57.352748 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3eb9275f-f270-4cd7-8c6f-063165910218 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:57.353183 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3eb9275f-f270-4cd7-8c6f-063165910218 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:57.468090 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b69d3788-0cf5-456f-99a8-ba897b461ad2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:57.469236 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b69d3788-0cf5-456f-99a8-ba897b461ad2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:57.475806 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b69d3788-0cf5-456f-99a8-ba897b461ad2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:57.476725 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b69d3788-0cf5-456f-99a8-ba897b461ad2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:57.477725 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b69d3788-0cf5-456f-99a8-ba897b461ad2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:57.478404 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b69d3788-0cf5-456f-99a8-ba897b461ad2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:57.501572 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3eb9275f-f270-4cd7-8c6f-063165910218 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:57.509291 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3eb9275f-f270-4cd7-8c6f-063165910218 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1372 microversion: 2.1 time: 0.170068 Jun 29 12:35:57.509853 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 185/390] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:57 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:57.615459 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b69d3788-0cf5-456f-99a8-ba897b461ad2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:57.623279 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b69d3788-0cf5-456f-99a8-ba897b461ad2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:57.625352 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b69d3788-0cf5-456f-99a8-ba897b461ad2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:57.626573 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b69d3788-0cf5-456f-99a8-ba897b461ad2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1743 microversion: 2.20 time: 0.162311 Jun 29 12:35:57.627124 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 206/391] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:35:57 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:35:58.167186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-21087bef-6a48-4fea-8849-fdc1954a7865 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:58.167792 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-21087bef-6a48-4fea-8849-fdc1954a7865 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:58.174575 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-21087bef-6a48-4fea-8849-fdc1954a7865 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:58.175019 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-21087bef-6a48-4fea-8849-fdc1954a7865 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:58.175773 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-21087bef-6a48-4fea-8849-fdc1954a7865 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:58.176222 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-21087bef-6a48-4fea-8849-fdc1954a7865 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:58.308163 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-21087bef-6a48-4fea-8849-fdc1954a7865 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:58.316027 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-21087bef-6a48-4fea-8849-fdc1954a7865 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1260 microversion: 2.1 time: 0.152953 Jun 29 12:35:58.316588 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 186/392] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:58 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:58.527013 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-977bdb2c-ce51-4a70-b924-c1f56226ca34 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:58.527626 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-977bdb2c-ce51-4a70-b924-c1f56226ca34 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:58.529478 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:35:58.535440 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-977bdb2c-ce51-4a70-b924-c1f56226ca34 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:58.535891 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-977bdb2c-ce51-4a70-b924-c1f56226ca34 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:58.536650 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-977bdb2c-ce51-4a70-b924-c1f56226ca34 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:58.537091 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-977bdb2c-ce51-4a70-b924-c1f56226ca34 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:58.643688 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f093b195-42d1-4537-89c0-b4d5139d376b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:58.645457 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f093b195-42d1-4537-89c0-b4d5139d376b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:58.652201 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f093b195-42d1-4537-89c0-b4d5139d376b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:58.652728 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f093b195-42d1-4537-89c0-b4d5139d376b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:58.653591 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f093b195-42d1-4537-89c0-b4d5139d376b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:58.654134 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f093b195-42d1-4537-89c0-b4d5139d376b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:58.675443 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-977bdb2c-ce51-4a70-b924-c1f56226ca34 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:58.682984 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-977bdb2c-ce51-4a70-b924-c1f56226ca34 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1372 microversion: 2.1 time: 0.159803 Jun 29 12:35:58.683545 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 207/393] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:58 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:58.783497 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f093b195-42d1-4537-89c0-b4d5139d376b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:58.791299 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f093b195-42d1-4537-89c0-b4d5139d376b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:58.792772 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f093b195-42d1-4537-89c0-b4d5139d376b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:58.793915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f093b195-42d1-4537-89c0-b4d5139d376b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1743 microversion: 2.20 time: 0.154199 Jun 29 12:35:58.794473 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 187/394] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:35:58 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:35:58.965975 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-ac60e311-d007-4d57-8980-36a0a99e70d4 req-6e140052-81f6-4e2a-b15b-8367469a89f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f2e3f4-c3b9-44d5-9648-2a68acec3d2c", "name": "network-vif-plugged", "status": "completed", "tag": "e0d184c2-5cac-4f0e-a86b-473ab610d153"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:35:58.974735 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-ac60e311-d007-4d57-8980-36a0a99e70d4 req-6e140052-81f6-4e2a-b15b-8367469a89f4 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:58.975181 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-ac60e311-d007-4d57-8980-36a0a99e70d4 req-6e140052-81f6-4e2a-b15b-8367469a89f4 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:58.986784 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-ac60e311-d007-4d57-8980-36a0a99e70d4 req-6e140052-81f6-4e2a-b15b-8367469a89f4 service nova] Creating event network-vif-plugged:e0d184c2-5cac-4f0e-a86b-473ab610d153 for instance 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c on hv-cinder-81268 Jun 29 12:35:58.991753 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-ac60e311-d007-4d57-8980-36a0a99e70d4 req-6e140052-81f6-4e2a-b15b-8367469a89f4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029543 Jun 29 12:35:58.992643 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 208/395] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:35:59.334583 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-08ce1875-bf85-4b99-9f1e-8c187ad96374 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:59.335109 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-08ce1875-bf85-4b99-9f1e-8c187ad96374 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:59.341523 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-08ce1875-bf85-4b99-9f1e-8c187ad96374 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:59.341883 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-08ce1875-bf85-4b99-9f1e-8c187ad96374 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:59.342689 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-08ce1875-bf85-4b99-9f1e-8c187ad96374 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:59.343126 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-08ce1875-bf85-4b99-9f1e-8c187ad96374 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:59.495790 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-08ce1875-bf85-4b99-9f1e-8c187ad96374 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:59.503777 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-08ce1875-bf85-4b99-9f1e-8c187ad96374 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1260 microversion: 2.1 time: 0.174400 Jun 29 12:35:59.504328 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 188/396] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:59 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:59.702587 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a25ae444-f51b-477a-99f6-d894b850be69 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:59.702587 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a25ae444-f51b-477a-99f6-d894b850be69 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:59.707286 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a25ae444-f51b-477a-99f6-d894b850be69 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:59.707736 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a25ae444-f51b-477a-99f6-d894b850be69 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:59.708501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a25ae444-f51b-477a-99f6-d894b850be69 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:59.708943 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a25ae444-f51b-477a-99f6-d894b850be69 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:59.811249 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4bf07596-307d-4ed7-9b9a-1e440a2b3212 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:35:59.812978 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4bf07596-307d-4ed7-9b9a-1e440a2b3212 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:35:59.819974 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4bf07596-307d-4ed7-9b9a-1e440a2b3212 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:59.820591 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4bf07596-307d-4ed7-9b9a-1e440a2b3212 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:59.821607 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4bf07596-307d-4ed7-9b9a-1e440a2b3212 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:35:59.822255 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4bf07596-307d-4ed7-9b9a-1e440a2b3212 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:35:59.866242 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a25ae444-f51b-477a-99f6-d894b850be69 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:59.879305 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a25ae444-f51b-477a-99f6-d894b850be69 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1372 microversion: 2.1 time: 0.183783 Jun 29 12:35:59.879978 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 209/397] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:35:59 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1372 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:35:59.964559 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4bf07596-307d-4ed7-9b9a-1e440a2b3212 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:59.974009 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4bf07596-307d-4ed7-9b9a-1e440a2b3212 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:59.975685 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4bf07596-307d-4ed7-9b9a-1e440a2b3212 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:35:59.976917 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4bf07596-307d-4ed7-9b9a-1e440a2b3212 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1738 microversion: 2.20 time: 0.169494 Jun 29 12:35:59.977495 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 189/398] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:35:59 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:00.521553 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-cb12e7c3-615e-477e-b3fc-84d38599411d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:00.522166 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-cb12e7c3-615e-477e-b3fc-84d38599411d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:00.530345 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cb12e7c3-615e-477e-b3fc-84d38599411d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:00.531195 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cb12e7c3-615e-477e-b3fc-84d38599411d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:00.532502 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cb12e7c3-615e-477e-b3fc-84d38599411d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:00.533132 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cb12e7c3-615e-477e-b3fc-84d38599411d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:00.687418 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-cb12e7c3-615e-477e-b3fc-84d38599411d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:00.696557 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-cb12e7c3-615e-477e-b3fc-84d38599411d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1260 microversion: 2.1 time: 0.179036 Jun 29 12:36:00.697447 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 210/399] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:36:00 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:36:00.904425 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e7d6f8da-4406-48fd-aa6d-c8a23fd07bb6 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:00.905311 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e7d6f8da-4406-48fd-aa6d-c8a23fd07bb6 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:00.926887 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e7d6f8da-4406-48fd-aa6d-c8a23fd07bb6 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:00.937404 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e7d6f8da-4406-48fd-aa6d-c8a23fd07bb6 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:00.939089 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e7d6f8da-4406-48fd-aa6d-c8a23fd07bb6 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:00.939915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e7d6f8da-4406-48fd-aa6d-c8a23fd07bb6 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:00.996776 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6ae1cc76-f447-4973-a6e6-c19c8fca8a24 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:00.998473 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-6ae1cc76-f447-4973-a6e6-c19c8fca8a24 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:01.013886 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6ae1cc76-f447-4973-a6e6-c19c8fca8a24 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:01.016348 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6ae1cc76-f447-4973-a6e6-c19c8fca8a24 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:01.017350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6ae1cc76-f447-4973-a6e6-c19c8fca8a24 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:01.020076 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6ae1cc76-f447-4973-a6e6-c19c8fca8a24 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:01.225703 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e7d6f8da-4406-48fd-aa6d-c8a23fd07bb6 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:01.238946 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e7d6f8da-4406-48fd-aa6d-c8a23fd07bb6 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1372 microversion: 2.1 time: 0.343433 Jun 29 12:36:01.250639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 190/400] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:36:00 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1372 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:36:01.266583 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6ae1cc76-f447-4973-a6e6-c19c8fca8a24 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:01.286166 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6ae1cc76-f447-4973-a6e6-c19c8fca8a24 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:01.288557 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6ae1cc76-f447-4973-a6e6-c19c8fca8a24 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:01.290447 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6ae1cc76-f447-4973-a6e6-c19c8fca8a24 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1738 microversion: 2.20 time: 0.297638 Jun 29 12:36:01.291184 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 211/401] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:00 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1738 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:36:01.721210 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b6d5074f-608c-4ecf-9d21-22fe94e9c8c3 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:01.722225 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b6d5074f-608c-4ecf-9d21-22fe94e9c8c3 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:01.731402 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b6d5074f-608c-4ecf-9d21-22fe94e9c8c3 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:01.732373 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b6d5074f-608c-4ecf-9d21-22fe94e9c8c3 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:01.733294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b6d5074f-608c-4ecf-9d21-22fe94e9c8c3 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:01.734152 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b6d5074f-608c-4ecf-9d21-22fe94e9c8c3 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:01.961642 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b6d5074f-608c-4ecf-9d21-22fe94e9c8c3 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:01.976299 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b6d5074f-608c-4ecf-9d21-22fe94e9c8c3 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1260 microversion: 2.1 time: 0.264895 Jun 29 12:36:01.976901 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 191/402] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:36:01 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1260 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:36:02.255853 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-587f36d0-7f6c-404a-a8ea-099bcbdf9d84 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:02.257473 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-587f36d0-7f6c-404a-a8ea-099bcbdf9d84 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:02.266253 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-587f36d0-7f6c-404a-a8ea-099bcbdf9d84 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:02.269438 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-587f36d0-7f6c-404a-a8ea-099bcbdf9d84 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:02.270937 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-587f36d0-7f6c-404a-a8ea-099bcbdf9d84 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:02.272541 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-587f36d0-7f6c-404a-a8ea-099bcbdf9d84 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:02.308794 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-99839225-479a-443c-b10e-ff3cfac46b99 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:02.309397 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-99839225-479a-443c-b10e-ff3cfac46b99 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:02.319430 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-99839225-479a-443c-b10e-ff3cfac46b99 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:02.321881 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-99839225-479a-443c-b10e-ff3cfac46b99 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:02.324051 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-99839225-479a-443c-b10e-ff3cfac46b99 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:02.324842 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-99839225-479a-443c-b10e-ff3cfac46b99 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:02.454396 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-587f36d0-7f6c-404a-a8ea-099bcbdf9d84 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:02.471412 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-587f36d0-7f6c-404a-a8ea-099bcbdf9d84 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1567 microversion: 2.1 time: 0.219269 Jun 29 12:36:02.488164 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 212/403] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:36:02 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:36:02.501293 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ec5372b6-e888-497a-a941-6d2490f436b7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:02.507865 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ec5372b6-e888-497a-a941-6d2490f436b7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:02.514051 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ec5372b6-e888-497a-a941-6d2490f436b7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:02.514525 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ec5372b6-e888-497a-a941-6d2490f436b7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:02.516835 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ec5372b6-e888-497a-a941-6d2490f436b7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:02.518272 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ec5372b6-e888-497a-a941-6d2490f436b7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:02.591803 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-99839225-479a-443c-b10e-ff3cfac46b99 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:02.616453 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-99839225-479a-443c-b10e-ff3cfac46b99 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:02.626693 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-99839225-479a-443c-b10e-ff3cfac46b99 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:02.628880 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-99839225-479a-443c-b10e-ff3cfac46b99 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1738 microversion: 2.20 time: 0.324065 Jun 29 12:36:02.634572 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 192/404] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:02 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1738 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:36:02.673661 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ec5372b6-e888-497a-a941-6d2490f436b7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.182931 Jun 29 12:36:02.674509 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 213/405] 10.222.0.52 () {58 vars in 1274 bytes} [Wed Jun 29 12:36:02 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c/os-interface => generated 285 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:36:02.993090 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-404b30a0-e9dc-4409-b9d9-11c9a4c60872 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:02.993619 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-404b30a0-e9dc-4409-b9d9-11c9a4c60872 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:03.001294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-404b30a0-e9dc-4409-b9d9-11c9a4c60872 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:03.002157 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-404b30a0-e9dc-4409-b9d9-11c9a4c60872 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:03.003403 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-404b30a0-e9dc-4409-b9d9-11c9a4c60872 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:03.004162 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-404b30a0-e9dc-4409-b9d9-11c9a4c60872 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:03.245834 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-404b30a0-e9dc-4409-b9d9-11c9a4c60872 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:03.255002 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-404b30a0-e9dc-4409-b9d9-11c9a4c60872 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1260 microversion: 2.1 time: 0.265681 Jun 29 12:36:03.259129 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 193/406] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:36:02 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1260 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:36:03.281545 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-9d419022-e03a-4576-a2e8-197118c336b4 req-160e4cf7-62ff-48e3-b369-1bc967cf8046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d615c3d2-4ba0-41e9-be7e-8e51d8e36b86", "name": "network-vif-plugged", "status": "completed", "tag": "c73e8ec9-3797-428f-82d9-0808363d1eab"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:36:03.300752 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-9d419022-e03a-4576-a2e8-197118c336b4 req-160e4cf7-62ff-48e3-b369-1bc967cf8046 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:03.301137 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-9d419022-e03a-4576-a2e8-197118c336b4 req-160e4cf7-62ff-48e3-b369-1bc967cf8046 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:03.313783 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-9d419022-e03a-4576-a2e8-197118c336b4 req-160e4cf7-62ff-48e3-b369-1bc967cf8046 service nova] Creating event network-vif-plugged:c73e8ec9-3797-428f-82d9-0808363d1eab for instance d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 on hv-cinder-81268 Jun 29 12:36:03.363101 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-9d419022-e03a-4576-a2e8-197118c336b4 req-160e4cf7-62ff-48e3-b369-1bc967cf8046 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085473 Jun 29 12:36:03.365007 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 214/407] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:36:03.649992 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-821c862c-45a9-42db-b0eb-4cad6cb923d3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:03.650662 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-821c862c-45a9-42db-b0eb-4cad6cb923d3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:03.658067 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-821c862c-45a9-42db-b0eb-4cad6cb923d3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:03.664925 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-821c862c-45a9-42db-b0eb-4cad6cb923d3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:03.666207 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-821c862c-45a9-42db-b0eb-4cad6cb923d3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:03.667202 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-821c862c-45a9-42db-b0eb-4cad6cb923d3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:03.896831 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-821c862c-45a9-42db-b0eb-4cad6cb923d3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:03.907707 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-821c862c-45a9-42db-b0eb-4cad6cb923d3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:03.909537 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-821c862c-45a9-42db-b0eb-4cad6cb923d3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:03.910979 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-821c862c-45a9-42db-b0eb-4cad6cb923d3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1738 microversion: 2.20 time: 0.265060 Jun 29 12:36:03.912088 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 194/408] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:03 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1738 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:36:04.279179 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-018f7c6f-adfc-4dc8-82cd-7450ea8e1773 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:04.281582 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-018f7c6f-adfc-4dc8-82cd-7450ea8e1773 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:04.290416 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-018f7c6f-adfc-4dc8-82cd-7450ea8e1773 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:04.291084 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-018f7c6f-adfc-4dc8-82cd-7450ea8e1773 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:04.292203 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-018f7c6f-adfc-4dc8-82cd-7450ea8e1773 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:04.292809 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-018f7c6f-adfc-4dc8-82cd-7450ea8e1773 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:04.511434 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-018f7c6f-adfc-4dc8-82cd-7450ea8e1773 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:04.525401 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-018f7c6f-adfc-4dc8-82cd-7450ea8e1773 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1260 microversion: 2.1 time: 0.249627 Jun 29 12:36:04.528123 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 215/409] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:36:04 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1260 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:36:04.603077 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-4abfa3e6-ca7d-41c0-85c4-c461a779089b req-e7ab6fbe-86b1-48d3-8846-26de13f8870b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44f2e3f4-c3b9-44d5-9648-2a68acec3d2c", "tag": "e0d184c2-5cac-4f0e-a86b-473ab610d153"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:36:04.612979 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-4abfa3e6-ca7d-41c0-85c4-c461a779089b req-e7ab6fbe-86b1-48d3-8846-26de13f8870b service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:04.613734 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-4abfa3e6-ca7d-41c0-85c4-c461a779089b req-e7ab6fbe-86b1-48d3-8846-26de13f8870b service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:04.628968 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-4abfa3e6-ca7d-41c0-85c4-c461a779089b req-e7ab6fbe-86b1-48d3-8846-26de13f8870b service nova] Creating event network-changed:e0d184c2-5cac-4f0e-a86b-473ab610d153 for instance 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c on hv-cinder-81268 Jun 29 12:36:04.637049 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-4abfa3e6-ca7d-41c0-85c4-c461a779089b req-e7ab6fbe-86b1-48d3-8846-26de13f8870b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039060 Jun 29 12:36:04.637944 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 195/410] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:36:04.930005 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ddab2300-8418-4552-8c6c-e9ef29ff13a8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:04.931050 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ddab2300-8418-4552-8c6c-e9ef29ff13a8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:04.938824 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ddab2300-8418-4552-8c6c-e9ef29ff13a8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:04.939668 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ddab2300-8418-4552-8c6c-e9ef29ff13a8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:04.940696 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ddab2300-8418-4552-8c6c-e9ef29ff13a8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:04.941384 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ddab2300-8418-4552-8c6c-e9ef29ff13a8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:05.111246 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ddab2300-8418-4552-8c6c-e9ef29ff13a8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:05.123072 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ddab2300-8418-4552-8c6c-e9ef29ff13a8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:05.125397 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ddab2300-8418-4552-8c6c-e9ef29ff13a8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:05.126838 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ddab2300-8418-4552-8c6c-e9ef29ff13a8 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1738 microversion: 2.20 time: 0.201038 Jun 29 12:36:05.127613 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 216/411] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:04 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:05.428032 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-7c39640f-368d-468b-9a3b-6109d0ddb934 req-2f2f1a88-37f5-4e7b-b5aa-0854b7c5c739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72186d8a-10a4-4b4a-b57e-6e8e520dc784", "name": "network-vif-plugged", "status": "completed", "tag": "32283955-f720-4723-80b6-82d0fc44730d"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:36:05.442099 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-7c39640f-368d-468b-9a3b-6109d0ddb934 req-2f2f1a88-37f5-4e7b-b5aa-0854b7c5c739 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:05.442880 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-7c39640f-368d-468b-9a3b-6109d0ddb934 req-2f2f1a88-37f5-4e7b-b5aa-0854b7c5c739 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:05.455137 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-7c39640f-368d-468b-9a3b-6109d0ddb934 req-2f2f1a88-37f5-4e7b-b5aa-0854b7c5c739 service nova] Creating event network-vif-plugged:32283955-f720-4723-80b6-82d0fc44730d for instance 72186d8a-10a4-4b4a-b57e-6e8e520dc784 on hv-cinder-81268 Jun 29 12:36:05.460431 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-7c39640f-368d-468b-9a3b-6109d0ddb934 req-2f2f1a88-37f5-4e7b-b5aa-0854b7c5c739 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036587 Jun 29 12:36:05.461616 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 196/412] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:36:05.544380 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-900d8535-ff59-47b8-b7b0-bf0d04e4bc7a tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:05.546023 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-900d8535-ff59-47b8-b7b0-bf0d04e4bc7a tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:05.553531 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-900d8535-ff59-47b8-b7b0-bf0d04e4bc7a tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:05.554663 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-900d8535-ff59-47b8-b7b0-bf0d04e4bc7a tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:05.555676 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-900d8535-ff59-47b8-b7b0-bf0d04e4bc7a tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:05.556442 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-900d8535-ff59-47b8-b7b0-bf0d04e4bc7a tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:05.778807 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-900d8535-ff59-47b8-b7b0-bf0d04e4bc7a tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:05.790184 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-900d8535-ff59-47b8-b7b0-bf0d04e4bc7a tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1260 microversion: 2.1 time: 0.250008 Jun 29 12:36:05.791021 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 217/413] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:36:05 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1260 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:36:06.146962 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8b8b2545-6a55-4bb8-bd7e-df9d5794c7c5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:06.148562 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8b8b2545-6a55-4bb8-bd7e-df9d5794c7c5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:06.156918 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8b8b2545-6a55-4bb8-bd7e-df9d5794c7c5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:06.157846 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8b8b2545-6a55-4bb8-bd7e-df9d5794c7c5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:06.159163 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8b8b2545-6a55-4bb8-bd7e-df9d5794c7c5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:06.159880 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8b8b2545-6a55-4bb8-bd7e-df9d5794c7c5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:06.325473 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8b8b2545-6a55-4bb8-bd7e-df9d5794c7c5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:06.335760 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8b8b2545-6a55-4bb8-bd7e-df9d5794c7c5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:06.341324 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8b8b2545-6a55-4bb8-bd7e-df9d5794c7c5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:06.344596 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8b8b2545-6a55-4bb8-bd7e-df9d5794c7c5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1738 microversion: 2.20 time: 0.201617 Jun 29 12:36:06.346957 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 197/414] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:06 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:06.808259 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-379aa8e6-7a37-4f84-b2ba-5ed7401d6bdf tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:06.809245 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-379aa8e6-7a37-4f84-b2ba-5ed7401d6bdf tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:06.815584 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-379aa8e6-7a37-4f84-b2ba-5ed7401d6bdf tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:06.816031 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-379aa8e6-7a37-4f84-b2ba-5ed7401d6bdf tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:06.816967 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-379aa8e6-7a37-4f84-b2ba-5ed7401d6bdf tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:06.818100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-379aa8e6-7a37-4f84-b2ba-5ed7401d6bdf tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:06.972601 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-379aa8e6-7a37-4f84-b2ba-5ed7401d6bdf tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:06.982132 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-379aa8e6-7a37-4f84-b2ba-5ed7401d6bdf tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1260 microversion: 2.1 time: 0.177608 Jun 29 12:36:06.983041 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 218/415] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:36:06 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:36:07.369013 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-851735ce-5567-4fa0-95d0-97ee6774f748 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:07.369618 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-851735ce-5567-4fa0-95d0-97ee6774f748 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:07.376670 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-851735ce-5567-4fa0-95d0-97ee6774f748 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:07.377109 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-851735ce-5567-4fa0-95d0-97ee6774f748 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:07.378394 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-851735ce-5567-4fa0-95d0-97ee6774f748 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:07.379036 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-851735ce-5567-4fa0-95d0-97ee6774f748 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:07.636562 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-851735ce-5567-4fa0-95d0-97ee6774f748 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:07.655968 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-851735ce-5567-4fa0-95d0-97ee6774f748 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:07.658720 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-851735ce-5567-4fa0-95d0-97ee6774f748 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:07.661303 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-851735ce-5567-4fa0-95d0-97ee6774f748 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1738 microversion: 2.20 time: 0.296328 Jun 29 12:36:07.676116 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 198/416] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:07 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1738 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:08.007900 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-98546f41-514d-49c5-a3b6-dcb113e71877 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:08.017815 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-98546f41-514d-49c5-a3b6-dcb113e71877 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:08.025145 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-98546f41-514d-49c5-a3b6-dcb113e71877 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:08.025920 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-98546f41-514d-49c5-a3b6-dcb113e71877 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:08.027386 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-98546f41-514d-49c5-a3b6-dcb113e71877 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:08.028032 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-98546f41-514d-49c5-a3b6-dcb113e71877 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:08.225845 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-98546f41-514d-49c5-a3b6-dcb113e71877 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:08.238399 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-98546f41-514d-49c5-a3b6-dcb113e71877 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1260 microversion: 2.1 time: 0.242050 Jun 29 12:36:08.239008 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 219/417] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:36:07 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1260 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:36:08.682660 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f1cfc6b9-90ba-4356-9315-b3b5d7fbf424 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:08.684007 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f1cfc6b9-90ba-4356-9315-b3b5d7fbf424 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:08.691929 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f1cfc6b9-90ba-4356-9315-b3b5d7fbf424 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:08.692380 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f1cfc6b9-90ba-4356-9315-b3b5d7fbf424 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:08.693441 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f1cfc6b9-90ba-4356-9315-b3b5d7fbf424 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:08.694034 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f1cfc6b9-90ba-4356-9315-b3b5d7fbf424 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:08.856328 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f1cfc6b9-90ba-4356-9315-b3b5d7fbf424 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:08.866596 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f1cfc6b9-90ba-4356-9315-b3b5d7fbf424 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:08.868038 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f1cfc6b9-90ba-4356-9315-b3b5d7fbf424 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:08.869202 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f1cfc6b9-90ba-4356-9315-b3b5d7fbf424 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1738 microversion: 2.20 time: 0.190807 Jun 29 12:36:08.869963 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 199/418] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:08 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:09.255402 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a8ed0c3d-10a6-4ace-b670-9720348fbbde tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:09.256792 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a8ed0c3d-10a6-4ace-b670-9720348fbbde tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:09.263304 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a8ed0c3d-10a6-4ace-b670-9720348fbbde tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:09.264032 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a8ed0c3d-10a6-4ace-b670-9720348fbbde tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:09.265593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a8ed0c3d-10a6-4ace-b670-9720348fbbde tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:09.266105 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a8ed0c3d-10a6-4ace-b670-9720348fbbde tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:09.416749 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a8ed0c3d-10a6-4ace-b670-9720348fbbde tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:09.425432 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a8ed0c3d-10a6-4ace-b670-9720348fbbde tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1260 microversion: 2.1 time: 0.173763 Jun 29 12:36:09.426354 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 220/419] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:36:09 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:36:09.887529 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b7560b5b-b3ec-402b-8728-42f16eead2f6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:09.888136 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b7560b5b-b3ec-402b-8728-42f16eead2f6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:09.895774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b7560b5b-b3ec-402b-8728-42f16eead2f6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:09.896602 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b7560b5b-b3ec-402b-8728-42f16eead2f6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:09.897665 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b7560b5b-b3ec-402b-8728-42f16eead2f6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:09.898365 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b7560b5b-b3ec-402b-8728-42f16eead2f6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:10.074885 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b7560b5b-b3ec-402b-8728-42f16eead2f6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:10.085028 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b7560b5b-b3ec-402b-8728-42f16eead2f6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:10.086568 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b7560b5b-b3ec-402b-8728-42f16eead2f6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:10.087793 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b7560b5b-b3ec-402b-8728-42f16eead2f6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1738 microversion: 2.20 time: 0.204046 Jun 29 12:36:10.088348 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 200/420] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:09 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:10.442884 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-2d09e065-aba9-4324-940b-412f579387c9 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:10.443499 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-2d09e065-aba9-4324-940b-412f579387c9 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:10.449498 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2d09e065-aba9-4324-940b-412f579387c9 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:10.449944 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2d09e065-aba9-4324-940b-412f579387c9 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:10.450724 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2d09e065-aba9-4324-940b-412f579387c9 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:10.451166 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2d09e065-aba9-4324-940b-412f579387c9 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:10.593221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2d09e065-aba9-4324-940b-412f579387c9 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:10.600755 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-2d09e065-aba9-4324-940b-412f579387c9 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1443 microversion: 2.1 time: 0.161700 Jun 29 12:36:10.601317 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 221/421] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:36:10 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1443 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:36:10.617710 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-65a4cb5b-8fdc-4ea3-acbc-ec0bd869c3ec tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:10.617710 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-65a4cb5b-8fdc-4ea3-acbc-ec0bd869c3ec tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:10.623744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-65a4cb5b-8fdc-4ea3-acbc-ec0bd869c3ec tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:10.624754 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-65a4cb5b-8fdc-4ea3-acbc-ec0bd869c3ec tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:10.625561 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-65a4cb5b-8fdc-4ea3-acbc-ec0bd869c3ec tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:10.626003 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-65a4cb5b-8fdc-4ea3-acbc-ec0bd869c3ec tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:10.760258 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-65a4cb5b-8fdc-4ea3-acbc-ec0bd869c3ec tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:10.763754 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=100 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:36:10.768876 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-65a4cb5b-8fdc-4ea3-acbc-ec0bd869c3ec tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1443 microversion: 2.1 time: 0.155623 Jun 29 12:36:10.769456 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 201/422] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:36:10 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:36:11.107254 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3e5e62e1-50e3-4c30-bf0d-12ec18ab7fde tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:11.107945 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3e5e62e1-50e3-4c30-bf0d-12ec18ab7fde tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:11.115708 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3e5e62e1-50e3-4c30-bf0d-12ec18ab7fde tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:11.116278 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3e5e62e1-50e3-4c30-bf0d-12ec18ab7fde tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:11.117118 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3e5e62e1-50e3-4c30-bf0d-12ec18ab7fde tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:11.117616 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3e5e62e1-50e3-4c30-bf0d-12ec18ab7fde tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:11.354395 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3e5e62e1-50e3-4c30-bf0d-12ec18ab7fde tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:11.370224 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3e5e62e1-50e3-4c30-bf0d-12ec18ab7fde tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:11.372114 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3e5e62e1-50e3-4c30-bf0d-12ec18ab7fde tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:11.373378 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3e5e62e1-50e3-4c30-bf0d-12ec18ab7fde tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1720 microversion: 2.20 time: 0.270307 Jun 29 12:36:11.374638 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 222/423] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:11 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1720 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:12.393801 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-85938dd8-3c74-4358-98de-8477fe2d0034 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:12.394582 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-85938dd8-3c74-4358-98de-8477fe2d0034 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:12.404125 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-85938dd8-3c74-4358-98de-8477fe2d0034 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:12.404586 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-85938dd8-3c74-4358-98de-8477fe2d0034 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:12.405405 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-85938dd8-3c74-4358-98de-8477fe2d0034 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:12.405850 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-85938dd8-3c74-4358-98de-8477fe2d0034 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:12.550502 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-85938dd8-3c74-4358-98de-8477fe2d0034 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:12.558471 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-85938dd8-3c74-4358-98de-8477fe2d0034 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:12.559975 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-85938dd8-3c74-4358-98de-8477fe2d0034 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:12.561355 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-85938dd8-3c74-4358-98de-8477fe2d0034 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1720 microversion: 2.20 time: 0.172153 Jun 29 12:36:12.562116 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 202/424] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:12 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:12.744610 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-96f22e60-a497-4c45-8071-4817769987d3 req-af58f574-3d6c-4db0-93e9-89dcf60a377b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72186d8a-10a4-4b4a-b57e-6e8e520dc784", "tag": "32283955-f720-4723-80b6-82d0fc44730d"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:36:12.753786 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-96f22e60-a497-4c45-8071-4817769987d3 req-af58f574-3d6c-4db0-93e9-89dcf60a377b service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:12.754234 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-96f22e60-a497-4c45-8071-4817769987d3 req-af58f574-3d6c-4db0-93e9-89dcf60a377b service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:12.758299 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=100 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:36:12.766285 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-96f22e60-a497-4c45-8071-4817769987d3 req-af58f574-3d6c-4db0-93e9-89dcf60a377b service nova] Creating event network-changed:32283955-f720-4723-80b6-82d0fc44730d for instance 72186d8a-10a4-4b4a-b57e-6e8e520dc784 on hv-cinder-81268 Jun 29 12:36:12.771560 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-96f22e60-a497-4c45-8071-4817769987d3 req-af58f574-3d6c-4db0-93e9-89dcf60a377b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030675 Jun 29 12:36:12.772147 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 223/425] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:36:13.581568 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-776cc57b-c8d0-4307-9655-e478dd254bc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:13.582210 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-776cc57b-c8d0-4307-9655-e478dd254bc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:13.589913 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-776cc57b-c8d0-4307-9655-e478dd254bc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:13.590373 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-776cc57b-c8d0-4307-9655-e478dd254bc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:13.591352 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-776cc57b-c8d0-4307-9655-e478dd254bc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:13.591798 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-776cc57b-c8d0-4307-9655-e478dd254bc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:13.761343 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-776cc57b-c8d0-4307-9655-e478dd254bc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:13.784520 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-776cc57b-c8d0-4307-9655-e478dd254bc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:13.786400 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-776cc57b-c8d0-4307-9655-e478dd254bc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:13.787613 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-776cc57b-c8d0-4307-9655-e478dd254bc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1723 microversion: 2.20 time: 0.211692 Jun 29 12:36:13.788471 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 203/426] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:13 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:13.807699 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b850c692-618b-42de-9b36-f7913c01e86c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5280dbbe-7840-4047-b223-5863efb38f3c"}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:36:13.809046 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b850c692-618b-42de-9b36-f7913c01e86c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:13.816187 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b850c692-618b-42de-9b36-f7913c01e86c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:13.817052 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b850c692-618b-42de-9b36-f7913c01e86c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:13.818074 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b850c692-618b-42de-9b36-f7913c01e86c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:13.818761 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b850c692-618b-42de-9b36-f7913c01e86c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:14.274133 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b850c692-618b-42de-9b36-f7913c01e86c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "POST /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.471160 Jun 29 12:36:14.274825 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 224/427] 10.222.0.52 () {62 vars in 1363 bytes} [Wed Jun 29 12:36:13 2022] POST /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86/os-volume_attachments => generated 188 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 12:36:14.395120 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1d82e8fa-89ed-4639-9c6a-048e01535429 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:36:14.396031 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-1d82e8fa-89ed-4639-9c6a-048e01535429 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:14.402913 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1d82e8fa-89ed-4639-9c6a-048e01535429 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:14.406526 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1d82e8fa-89ed-4639-9c6a-048e01535429 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:14.407431 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1d82e8fa-89ed-4639-9c6a-048e01535429 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:14.407811 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1d82e8fa-89ed-4639-9c6a-048e01535429 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:14.516564 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-1d82e8fa-89ed-4639-9c6a-048e01535429 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "POST /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86/action" status: 202 len: 0 microversion: 2.20 time: 0.123659 Jun 29 12:36:14.518536 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 204/428] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Jun 29 12:36:14 2022] POST /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 29 12:36:14.526871 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6c867a92-9b21-4e8f-aa6b-f81c95013f54 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:14.527608 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-6c867a92-9b21-4e8f-aa6b-f81c95013f54 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:14.534320 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6c867a92-9b21-4e8f-aa6b-f81c95013f54 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:14.534798 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6c867a92-9b21-4e8f-aa6b-f81c95013f54 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:14.535579 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6c867a92-9b21-4e8f-aa6b-f81c95013f54 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:14.536019 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6c867a92-9b21-4e8f-aa6b-f81c95013f54 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:14.695626 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6c867a92-9b21-4e8f-aa6b-f81c95013f54 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:14.709548 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6c867a92-9b21-4e8f-aa6b-f81c95013f54 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:14.711433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6c867a92-9b21-4e8f-aa6b-f81c95013f54 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:14.712678 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6c867a92-9b21-4e8f-aa6b-f81c95013f54 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1749 microversion: 2.20 time: 0.189801 Jun 29 12:36:14.713937 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 225/429] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:14 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1749 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:36:15.195901 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-d7f2a8ec-57e7-4c6c-b801-5f7e44a825d3 req-5806a518-2e39-4a30-bb59-5cd225fd7c39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d615c3d2-4ba0-41e9-be7e-8e51d8e36b86", "name": "network-vif-unplugged", "status": "completed", "tag": "c73e8ec9-3797-428f-82d9-0808363d1eab"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:36:15.207462 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:36:15.210364 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-d7f2a8ec-57e7-4c6c-b801-5f7e44a825d3 req-5806a518-2e39-4a30-bb59-5cd225fd7c39 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:15.210976 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-d7f2a8ec-57e7-4c6c-b801-5f7e44a825d3 req-5806a518-2e39-4a30-bb59-5cd225fd7c39 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:15.225744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.compute.server_external_events [req-d7f2a8ec-57e7-4c6c-b801-5f7e44a825d3 req-5806a518-2e39-4a30-bb59-5cd225fd7c39 service nova] Unable to find a host for instance d615c3d2-4ba0-41e9-be7e-8e51d8e36b86. Dropping event network-vif-unplugged {{(pid=124316) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 29 12:36:15.227493 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-d7f2a8ec-57e7-4c6c-b801-5f7e44a825d3 req-5806a518-2e39-4a30-bb59-5cd225fd7c39 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037213 Jun 29 12:36:15.228328 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 205/430] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 29 12:36:15.731852 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4b87235f-28d2-4d10-adee-d01e1df30cb7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:15.732463 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4b87235f-28d2-4d10-adee-d01e1df30cb7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:15.740184 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4b87235f-28d2-4d10-adee-d01e1df30cb7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:15.740634 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4b87235f-28d2-4d10-adee-d01e1df30cb7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:15.741399 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4b87235f-28d2-4d10-adee-d01e1df30cb7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:15.741834 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4b87235f-28d2-4d10-adee-d01e1df30cb7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:15.885621 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4b87235f-28d2-4d10-adee-d01e1df30cb7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:15.894663 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4b87235f-28d2-4d10-adee-d01e1df30cb7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:15.896432 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4b87235f-28d2-4d10-adee-d01e1df30cb7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:15.897625 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4b87235f-28d2-4d10-adee-d01e1df30cb7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1749 microversion: 2.20 time: 0.170046 Jun 29 12:36:15.898117 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 226/431] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:15 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1749 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:16.916947 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e68b11c2-d33d-4e15-a7b3-1635eda264f6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:16.917661 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e68b11c2-d33d-4e15-a7b3-1635eda264f6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:16.926918 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e68b11c2-d33d-4e15-a7b3-1635eda264f6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:16.927410 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e68b11c2-d33d-4e15-a7b3-1635eda264f6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:16.928235 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e68b11c2-d33d-4e15-a7b3-1635eda264f6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:16.928670 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e68b11c2-d33d-4e15-a7b3-1635eda264f6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:17.149186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e68b11c2-d33d-4e15-a7b3-1635eda264f6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:17.158756 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e68b11c2-d33d-4e15-a7b3-1635eda264f6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:17.160245 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e68b11c2-d33d-4e15-a7b3-1635eda264f6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:17.161381 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e68b11c2-d33d-4e15-a7b3-1635eda264f6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1807 microversion: 2.20 time: 0.248963 Jun 29 12:36:17.161932 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 206/432] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:16 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1807 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:18.182810 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b13b17fd-b815-456d-a7b5-6684b3fa8462 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:18.184497 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b13b17fd-b815-456d-a7b5-6684b3fa8462 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:18.198129 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b13b17fd-b815-456d-a7b5-6684b3fa8462 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:18.199101 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b13b17fd-b815-456d-a7b5-6684b3fa8462 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:18.200529 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b13b17fd-b815-456d-a7b5-6684b3fa8462 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:18.206200 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b13b17fd-b815-456d-a7b5-6684b3fa8462 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:18.434162 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b13b17fd-b815-456d-a7b5-6684b3fa8462 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:18.445970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b13b17fd-b815-456d-a7b5-6684b3fa8462 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:18.448187 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b13b17fd-b815-456d-a7b5-6684b3fa8462 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:18.449907 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b13b17fd-b815-456d-a7b5-6684b3fa8462 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1807 microversion: 2.20 time: 0.273620 Jun 29 12:36:18.450718 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 227/433] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:18 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1807 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:19.469939 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4377e333-3f80-45cb-9535-06421c3dabd5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:19.470717 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4377e333-3f80-45cb-9535-06421c3dabd5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:19.477981 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4377e333-3f80-45cb-9535-06421c3dabd5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:19.478473 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4377e333-3f80-45cb-9535-06421c3dabd5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:19.479261 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4377e333-3f80-45cb-9535-06421c3dabd5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:19.479704 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4377e333-3f80-45cb-9535-06421c3dabd5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:19.645589 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4377e333-3f80-45cb-9535-06421c3dabd5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:19.654456 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4377e333-3f80-45cb-9535-06421c3dabd5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:19.657046 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4377e333-3f80-45cb-9535-06421c3dabd5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:19.658872 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4377e333-3f80-45cb-9535-06421c3dabd5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1807 microversion: 2.20 time: 0.193739 Jun 29 12:36:19.660067 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 207/434] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:19 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:20.686980 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3fc46a9c-a789-4e1e-aa0e-811488f2d03d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:20.688385 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3fc46a9c-a789-4e1e-aa0e-811488f2d03d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:20.694430 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3fc46a9c-a789-4e1e-aa0e-811488f2d03d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:20.694893 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3fc46a9c-a789-4e1e-aa0e-811488f2d03d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:20.695656 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3fc46a9c-a789-4e1e-aa0e-811488f2d03d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:20.696092 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3fc46a9c-a789-4e1e-aa0e-811488f2d03d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:20.885172 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3fc46a9c-a789-4e1e-aa0e-811488f2d03d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:20.894460 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3fc46a9c-a789-4e1e-aa0e-811488f2d03d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:20.896504 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3fc46a9c-a789-4e1e-aa0e-811488f2d03d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:20.897857 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3fc46a9c-a789-4e1e-aa0e-811488f2d03d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1807 microversion: 2.20 time: 0.215672 Jun 29 12:36:20.898982 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 228/435] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:20 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1807 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:21.918414 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2249de05-8ecc-48fe-8776-1c245d98f7ef tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:21.919685 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2249de05-8ecc-48fe-8776-1c245d98f7ef tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:21.928767 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2249de05-8ecc-48fe-8776-1c245d98f7ef tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:21.929565 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2249de05-8ecc-48fe-8776-1c245d98f7ef tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:21.930932 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2249de05-8ecc-48fe-8776-1c245d98f7ef tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:21.931367 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2249de05-8ecc-48fe-8776-1c245d98f7ef tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:22.086114 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2249de05-8ecc-48fe-8776-1c245d98f7ef tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:22.095948 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2249de05-8ecc-48fe-8776-1c245d98f7ef tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:22.097849 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2249de05-8ecc-48fe-8776-1c245d98f7ef tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:22.099297 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2249de05-8ecc-48fe-8776-1c245d98f7ef tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1807 microversion: 2.20 time: 0.184896 Jun 29 12:36:22.100387 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 208/436] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:21 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:23.120394 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-57085d8d-30f9-45fd-a286-285361489a22 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:23.121100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-57085d8d-30f9-45fd-a286-285361489a22 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:23.133992 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-57085d8d-30f9-45fd-a286-285361489a22 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:23.133992 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-57085d8d-30f9-45fd-a286-285361489a22 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:23.133992 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-57085d8d-30f9-45fd-a286-285361489a22 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:23.136286 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-57085d8d-30f9-45fd-a286-285361489a22 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:23.319782 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-57085d8d-30f9-45fd-a286-285361489a22 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:23.329641 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-57085d8d-30f9-45fd-a286-285361489a22 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:23.331179 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-57085d8d-30f9-45fd-a286-285361489a22 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:23.332346 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-57085d8d-30f9-45fd-a286-285361489a22 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1807 microversion: 2.20 time: 0.217584 Jun 29 12:36:23.332907 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 229/437] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:23 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1807 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:24.351405 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4a0557cd-b4ec-4073-bea0-1c7bf0119e1c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:24.352014 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4a0557cd-b4ec-4073-bea0-1c7bf0119e1c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:24.359878 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4a0557cd-b4ec-4073-bea0-1c7bf0119e1c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:24.360727 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4a0557cd-b4ec-4073-bea0-1c7bf0119e1c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:24.361692 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4a0557cd-b4ec-4073-bea0-1c7bf0119e1c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:24.362296 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4a0557cd-b4ec-4073-bea0-1c7bf0119e1c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:24.506185 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4a0557cd-b4ec-4073-bea0-1c7bf0119e1c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:24.517019 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4a0557cd-b4ec-4073-bea0-1c7bf0119e1c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:24.518622 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4a0557cd-b4ec-4073-bea0-1c7bf0119e1c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:24.519823 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4a0557cd-b4ec-4073-bea0-1c7bf0119e1c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1807 microversion: 2.20 time: 0.172344 Jun 29 12:36:24.520683 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 209/438] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:24 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:25.539460 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-7bbc50d5-e9d0-4e9d-9c75-b53843d6b04f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:25.540063 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-7bbc50d5-e9d0-4e9d-9c75-b53843d6b04f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:25.547882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7bbc50d5-e9d0-4e9d-9c75-b53843d6b04f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:25.548547 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7bbc50d5-e9d0-4e9d-9c75-b53843d6b04f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:25.549426 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7bbc50d5-e9d0-4e9d-9c75-b53843d6b04f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:25.549937 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7bbc50d5-e9d0-4e9d-9c75-b53843d6b04f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:25.760927 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7bbc50d5-e9d0-4e9d-9c75-b53843d6b04f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:25.771930 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7bbc50d5-e9d0-4e9d-9c75-b53843d6b04f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:25.774359 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7bbc50d5-e9d0-4e9d-9c75-b53843d6b04f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:25.775649 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-7bbc50d5-e9d0-4e9d-9c75-b53843d6b04f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1807 microversion: 2.20 time: 0.240367 Jun 29 12:36:25.786508 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 230/439] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:25 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1807 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:26.795428 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d4b455d3-8a4a-4348-bc5b-c68b942d54cc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:26.796497 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d4b455d3-8a4a-4348-bc5b-c68b942d54cc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:26.804029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d4b455d3-8a4a-4348-bc5b-c68b942d54cc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:26.804471 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d4b455d3-8a4a-4348-bc5b-c68b942d54cc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:26.805239 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d4b455d3-8a4a-4348-bc5b-c68b942d54cc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:26.805672 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d4b455d3-8a4a-4348-bc5b-c68b942d54cc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:26.941402 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d4b455d3-8a4a-4348-bc5b-c68b942d54cc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:26.952436 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d4b455d3-8a4a-4348-bc5b-c68b942d54cc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:26.954218 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d4b455d3-8a4a-4348-bc5b-c68b942d54cc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:26.955419 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d4b455d3-8a4a-4348-bc5b-c68b942d54cc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1807 microversion: 2.20 time: 0.164173 Jun 29 12:36:26.955973 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 210/440] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:26 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:27.973858 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f342fa70-e580-44b5-95d7-4adc3982aabe tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:27.974477 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f342fa70-e580-44b5-95d7-4adc3982aabe tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:27.980458 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f342fa70-e580-44b5-95d7-4adc3982aabe tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:27.980902 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f342fa70-e580-44b5-95d7-4adc3982aabe tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:27.981656 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f342fa70-e580-44b5-95d7-4adc3982aabe tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:27.982090 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f342fa70-e580-44b5-95d7-4adc3982aabe tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:28.121598 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f342fa70-e580-44b5-95d7-4adc3982aabe tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:28.130800 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f342fa70-e580-44b5-95d7-4adc3982aabe tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:28.132277 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f342fa70-e580-44b5-95d7-4adc3982aabe tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:28.133474 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f342fa70-e580-44b5-95d7-4adc3982aabe tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1807 microversion: 2.20 time: 0.163472 Jun 29 12:36:28.134025 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 231/441] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:27 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:29.151595 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f088d1c6-e42b-417e-af0f-5be80e4fe737 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:29.152204 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f088d1c6-e42b-417e-af0f-5be80e4fe737 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:29.158624 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f088d1c6-e42b-417e-af0f-5be80e4fe737 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:29.159071 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f088d1c6-e42b-417e-af0f-5be80e4fe737 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:29.159821 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f088d1c6-e42b-417e-af0f-5be80e4fe737 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:29.160254 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f088d1c6-e42b-417e-af0f-5be80e4fe737 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:29.290124 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f088d1c6-e42b-417e-af0f-5be80e4fe737 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:29.298835 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f088d1c6-e42b-417e-af0f-5be80e4fe737 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:29.300320 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f088d1c6-e42b-417e-af0f-5be80e4fe737 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:29.301458 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f088d1c6-e42b-417e-af0f-5be80e4fe737 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1807 microversion: 2.20 time: 0.153754 Jun 29 12:36:29.302008 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 211/442] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:29 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:30.319959 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-cf165f05-4dd4-48c8-b8f7-49ccbea2b4a6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:30.320555 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-cf165f05-4dd4-48c8-b8f7-49ccbea2b4a6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:30.322547 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=50 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:36:30.328495 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cf165f05-4dd4-48c8-b8f7-49ccbea2b4a6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:30.328936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cf165f05-4dd4-48c8-b8f7-49ccbea2b4a6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:30.329686 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cf165f05-4dd4-48c8-b8f7-49ccbea2b4a6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:30.330114 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-cf165f05-4dd4-48c8-b8f7-49ccbea2b4a6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:30.462875 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-cf165f05-4dd4-48c8-b8f7-49ccbea2b4a6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:30.472163 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-cf165f05-4dd4-48c8-b8f7-49ccbea2b4a6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:30.473826 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-cf165f05-4dd4-48c8-b8f7-49ccbea2b4a6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:30.475001 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-cf165f05-4dd4-48c8-b8f7-49ccbea2b4a6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1807 microversion: 2.20 time: 0.158949 Jun 29 12:36:30.475545 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 232/443] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:30 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:31.493052 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-23353a03-386d-41a2-b693-6daeb7868ba5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:31.493636 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-23353a03-386d-41a2-b693-6daeb7868ba5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:31.500041 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-23353a03-386d-41a2-b693-6daeb7868ba5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:31.500481 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-23353a03-386d-41a2-b693-6daeb7868ba5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:31.501224 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-23353a03-386d-41a2-b693-6daeb7868ba5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:31.501656 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-23353a03-386d-41a2-b693-6daeb7868ba5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:31.629135 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-23353a03-386d-41a2-b693-6daeb7868ba5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:31.637503 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-23353a03-386d-41a2-b693-6daeb7868ba5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:31.639110 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-23353a03-386d-41a2-b693-6daeb7868ba5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:31.640251 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-23353a03-386d-41a2-b693-6daeb7868ba5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1807 microversion: 2.20 time: 0.151136 Jun 29 12:36:31.640816 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 212/444] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:31 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:32.659052 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1e7bb7e9-d625-4309-964e-a7077da4e82f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:32.659658 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1e7bb7e9-d625-4309-964e-a7077da4e82f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:32.666393 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1e7bb7e9-d625-4309-964e-a7077da4e82f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:32.666936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1e7bb7e9-d625-4309-964e-a7077da4e82f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:32.667690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1e7bb7e9-d625-4309-964e-a7077da4e82f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:32.668210 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1e7bb7e9-d625-4309-964e-a7077da4e82f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:32.800449 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1e7bb7e9-d625-4309-964e-a7077da4e82f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:32.808794 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1e7bb7e9-d625-4309-964e-a7077da4e82f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:32.810291 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1e7bb7e9-d625-4309-964e-a7077da4e82f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:32.813536 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1e7bb7e9-d625-4309-964e-a7077da4e82f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1807 microversion: 2.20 time: 0.159297 Jun 29 12:36:32.814093 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 233/445] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:32 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:33.832060 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b8e89cbf-535a-4876-91d2-693a6029345e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:33.832662 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b8e89cbf-535a-4876-91d2-693a6029345e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:33.839136 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b8e89cbf-535a-4876-91d2-693a6029345e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:33.839581 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b8e89cbf-535a-4876-91d2-693a6029345e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:33.840339 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b8e89cbf-535a-4876-91d2-693a6029345e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:33.840799 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b8e89cbf-535a-4876-91d2-693a6029345e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:33.973454 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b8e89cbf-535a-4876-91d2-693a6029345e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:33.981983 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b8e89cbf-535a-4876-91d2-693a6029345e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:33.984257 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b8e89cbf-535a-4876-91d2-693a6029345e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:33.985530 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b8e89cbf-535a-4876-91d2-693a6029345e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1807 microversion: 2.20 time: 0.157291 Jun 29 12:36:33.986172 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 213/446] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:33 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:36:35.005272 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-dc79561b-4bb5-407f-af18-d35205a16dfc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:35.005898 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-dc79561b-4bb5-407f-af18-d35205a16dfc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:35.012193 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dc79561b-4bb5-407f-af18-d35205a16dfc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:35.012636 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dc79561b-4bb5-407f-af18-d35205a16dfc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:35.013384 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dc79561b-4bb5-407f-af18-d35205a16dfc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:35.013812 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dc79561b-4bb5-407f-af18-d35205a16dfc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:35.144185 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-dc79561b-4bb5-407f-af18-d35205a16dfc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:35.152801 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-dc79561b-4bb5-407f-af18-d35205a16dfc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:35.154299 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-dc79561b-4bb5-407f-af18-d35205a16dfc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:35.156005 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-dc79561b-4bb5-407f-af18-d35205a16dfc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1807 microversion: 2.20 time: 0.155213 Jun 29 12:36:35.156557 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 234/447] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:34 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:36:36.173921 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d3947e8d-4fff-40ea-8077-e8a68df48fe7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:36.175176 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d3947e8d-4fff-40ea-8077-e8a68df48fe7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:36.182303 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d3947e8d-4fff-40ea-8077-e8a68df48fe7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:36.182871 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d3947e8d-4fff-40ea-8077-e8a68df48fe7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:36.183645 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d3947e8d-4fff-40ea-8077-e8a68df48fe7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:36.184115 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d3947e8d-4fff-40ea-8077-e8a68df48fe7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:36.314518 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d3947e8d-4fff-40ea-8077-e8a68df48fe7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:36.322758 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d3947e8d-4fff-40ea-8077-e8a68df48fe7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:36.324249 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d3947e8d-4fff-40ea-8077-e8a68df48fe7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:36.325386 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d3947e8d-4fff-40ea-8077-e8a68df48fe7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1807 microversion: 2.20 time: 0.155472 Jun 29 12:36:36.325929 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 214/448] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:36 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:37.343235 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c7a064be-3c58-4d41-9ae4-3e9b68992451 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:37.344543 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c7a064be-3c58-4d41-9ae4-3e9b68992451 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:37.350712 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c7a064be-3c58-4d41-9ae4-3e9b68992451 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:37.351161 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c7a064be-3c58-4d41-9ae4-3e9b68992451 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:37.351932 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c7a064be-3c58-4d41-9ae4-3e9b68992451 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:37.352364 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c7a064be-3c58-4d41-9ae4-3e9b68992451 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:37.484598 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c7a064be-3c58-4d41-9ae4-3e9b68992451 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:37.493478 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c7a064be-3c58-4d41-9ae4-3e9b68992451 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:37.495011 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c7a064be-3c58-4d41-9ae4-3e9b68992451 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:37.496229 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c7a064be-3c58-4d41-9ae4-3e9b68992451 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1807 microversion: 2.20 time: 0.156995 Jun 29 12:36:37.496810 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 235/449] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:37 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:36:38.514629 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-39e22da1-23ae-486c-be6d-05661f6c0f30 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:38.515242 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-39e22da1-23ae-486c-be6d-05661f6c0f30 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:38.522037 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-39e22da1-23ae-486c-be6d-05661f6c0f30 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:38.522513 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-39e22da1-23ae-486c-be6d-05661f6c0f30 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:38.523283 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-39e22da1-23ae-486c-be6d-05661f6c0f30 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:38.523722 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-39e22da1-23ae-486c-be6d-05661f6c0f30 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:38.653928 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-39e22da1-23ae-486c-be6d-05661f6c0f30 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:38.663711 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-39e22da1-23ae-486c-be6d-05661f6c0f30 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:38.665207 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-39e22da1-23ae-486c-be6d-05661f6c0f30 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:38.666343 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-39e22da1-23ae-486c-be6d-05661f6c0f30 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1807 microversion: 2.20 time: 0.155758 Jun 29 12:36:38.666920 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 215/450] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:38 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:39.409474 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-438d0acb-71a0-4242-b7f7-fb1d058ea0e1 req-a0039156-d8e6-45f3-9e51-ca39db429086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d615c3d2-4ba0-41e9-be7e-8e51d8e36b86", "name": "network-vif-plugged", "status": "completed", "tag": "c73e8ec9-3797-428f-82d9-0808363d1eab"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:36:39.418029 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-438d0acb-71a0-4242-b7f7-fb1d058ea0e1 req-a0039156-d8e6-45f3-9e51-ca39db429086 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:39.418537 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-438d0acb-71a0-4242-b7f7-fb1d058ea0e1 req-a0039156-d8e6-45f3-9e51-ca39db429086 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:39.430190 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-438d0acb-71a0-4242-b7f7-fb1d058ea0e1 req-a0039156-d8e6-45f3-9e51-ca39db429086 service nova] Creating event network-vif-plugged:c73e8ec9-3797-428f-82d9-0808363d1eab for instance d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 on hv-cinder-81268 Jun 29 12:36:39.435130 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-438d0acb-71a0-4242-b7f7-fb1d058ea0e1 req-a0039156-d8e6-45f3-9e51-ca39db429086 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029224 Jun 29 12:36:39.436552 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 236/451] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:36:39.685545 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5749429d-479b-4b9c-81e5-14d7e4d14095 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:39.687162 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5749429d-479b-4b9c-81e5-14d7e4d14095 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:39.693582 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5749429d-479b-4b9c-81e5-14d7e4d14095 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:39.694029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5749429d-479b-4b9c-81e5-14d7e4d14095 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:39.694822 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5749429d-479b-4b9c-81e5-14d7e4d14095 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:39.695258 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5749429d-479b-4b9c-81e5-14d7e4d14095 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:39.829407 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5749429d-479b-4b9c-81e5-14d7e4d14095 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:39.838388 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5749429d-479b-4b9c-81e5-14d7e4d14095 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:39.839894 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5749429d-479b-4b9c-81e5-14d7e4d14095 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:39.841242 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5749429d-479b-4b9c-81e5-14d7e4d14095 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1807 microversion: 2.20 time: 0.159711 Jun 29 12:36:39.841776 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 216/452] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:39 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:39.992012 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-dad99c08-8fd7-4961-b4e5-163601027fd3 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:39.992592 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-dad99c08-8fd7-4961-b4e5-163601027fd3 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:39.999236 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dad99c08-8fd7-4961-b4e5-163601027fd3 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:39.999685 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dad99c08-8fd7-4961-b4e5-163601027fd3 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:40.000441 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dad99c08-8fd7-4961-b4e5-163601027fd3 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:40.000878 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dad99c08-8fd7-4961-b4e5-163601027fd3 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:40.125970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-dad99c08-8fd7-4961-b4e5-163601027fd3 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lazy-loading 'services' on Instance uuid 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 12:36:40.227000 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:36:40.238917 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-dad99c08-8fd7-4961-b4e5-163601027fd3 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "DELETE /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4/os-volume_attachments/a6e33ddf-2c1d-4487-bc23-f5dc32deeb6f" status: 202 len: 0 microversion: 2.1 time: 0.251013 Jun 29 12:36:40.239506 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 237/453] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 12:36:39 2022] DELETE /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4/os-volume_attachments/a6e33ddf-2c1d-4487-bc23-f5dc32deeb6f => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:36:40.859502 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9a1beadd-b0cd-450a-9af8-b5c340bd230e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:40.860103 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-9a1beadd-b0cd-450a-9af8-b5c340bd230e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:40.866592 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9a1beadd-b0cd-450a-9af8-b5c340bd230e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:40.867036 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9a1beadd-b0cd-450a-9af8-b5c340bd230e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:40.867783 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9a1beadd-b0cd-450a-9af8-b5c340bd230e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:40.868211 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9a1beadd-b0cd-450a-9af8-b5c340bd230e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:40.997693 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9a1beadd-b0cd-450a-9af8-b5c340bd230e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:41.006516 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9a1beadd-b0cd-450a-9af8-b5c340bd230e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:41.008016 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9a1beadd-b0cd-450a-9af8-b5c340bd230e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:41.009156 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9a1beadd-b0cd-450a-9af8-b5c340bd230e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1807 microversion: 2.20 time: 0.153694 Jun 29 12:36:41.009713 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 217/454] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:40 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:42.028344 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e84ab7f4-e76b-4d03-93ab-b5892aa6eaec tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:42.028946 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e84ab7f4-e76b-4d03-93ab-b5892aa6eaec tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:42.036759 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e84ab7f4-e76b-4d03-93ab-b5892aa6eaec tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:42.037207 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e84ab7f4-e76b-4d03-93ab-b5892aa6eaec tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:42.038081 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e84ab7f4-e76b-4d03-93ab-b5892aa6eaec tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:42.038780 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e84ab7f4-e76b-4d03-93ab-b5892aa6eaec tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:42.180225 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e84ab7f4-e76b-4d03-93ab-b5892aa6eaec tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:42.190476 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e84ab7f4-e76b-4d03-93ab-b5892aa6eaec tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:42.191966 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e84ab7f4-e76b-4d03-93ab-b5892aa6eaec tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:42.193164 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e84ab7f4-e76b-4d03-93ab-b5892aa6eaec tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1807 microversion: 2.20 time: 0.169233 Jun 29 12:36:42.193708 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 238/455] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:42 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:42.416414 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5d3ad51c-2889-40ba-8795-9f24fdd137cd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:36:42.423633 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5d3ad51c-2889-40ba-8795-9f24fdd137cd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:42.424076 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5d3ad51c-2889-40ba-8795-9f24fdd137cd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:42.426207 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:36:42.448270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5d3ad51c-2889-40ba-8795-9f24fdd137cd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Going to try to stop instance {{(pid=124316) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 29 12:36:42.492318 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5d3ad51c-2889-40ba-8795-9f24fdd137cd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "POST /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4/action" status: 202 len: 0 microversion: 2.1 time: 0.079561 Jun 29 12:36:42.492904 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 218/456] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 12:36:42 2022] POST /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:36:42.502073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-129b591f-ad23-4cee-80dd-2382466a06c7 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:42.502704 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-129b591f-ad23-4cee-80dd-2382466a06c7 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:42.508670 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-129b591f-ad23-4cee-80dd-2382466a06c7 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:42.509112 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-129b591f-ad23-4cee-80dd-2382466a06c7 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:42.509860 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-129b591f-ad23-4cee-80dd-2382466a06c7 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:42.510284 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-129b591f-ad23-4cee-80dd-2382466a06c7 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:42.643971 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-129b591f-ad23-4cee-80dd-2382466a06c7 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:42.651878 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-129b591f-ad23-4cee-80dd-2382466a06c7 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1679 microversion: 2.1 time: 0.154541 Jun 29 12:36:42.652285 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 239/457] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:36:42 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:36:43.212142 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2b792f15-9e18-42f6-84da-92af3ec8aaa7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:43.212853 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2b792f15-9e18-42f6-84da-92af3ec8aaa7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:43.219188 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2b792f15-9e18-42f6-84da-92af3ec8aaa7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:43.219641 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2b792f15-9e18-42f6-84da-92af3ec8aaa7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:43.220402 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2b792f15-9e18-42f6-84da-92af3ec8aaa7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:43.220844 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2b792f15-9e18-42f6-84da-92af3ec8aaa7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:43.363235 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2b792f15-9e18-42f6-84da-92af3ec8aaa7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:43.371654 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2b792f15-9e18-42f6-84da-92af3ec8aaa7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:43.373180 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2b792f15-9e18-42f6-84da-92af3ec8aaa7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:43.374337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2b792f15-9e18-42f6-84da-92af3ec8aaa7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1794 microversion: 2.20 time: 0.166518 Jun 29 12:36:43.374941 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 219/458] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:36:43 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1794 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:36:43.668966 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3a77d6b4-dd76-42b2-bf07-eae78c5d8595 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:43.669560 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3a77d6b4-dd76-42b2-bf07-eae78c5d8595 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:43.676249 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3a77d6b4-dd76-42b2-bf07-eae78c5d8595 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:43.676692 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3a77d6b4-dd76-42b2-bf07-eae78c5d8595 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:43.677433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3a77d6b4-dd76-42b2-bf07-eae78c5d8595 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:43.677858 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3a77d6b4-dd76-42b2-bf07-eae78c5d8595 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:43.811325 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3a77d6b4-dd76-42b2-bf07-eae78c5d8595 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:43.818762 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3a77d6b4-dd76-42b2-bf07-eae78c5d8595 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1679 microversion: 2.1 time: 0.153549 Jun 29 12:36:43.819313 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 240/459] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:36:43 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:36:44.836882 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-cacfc988-95e7-412b-805c-5c08de0a7fc9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:44.837483 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-cacfc988-95e7-412b-805c-5c08de0a7fc9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:44.843938 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cacfc988-95e7-412b-805c-5c08de0a7fc9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:44.844414 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cacfc988-95e7-412b-805c-5c08de0a7fc9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:44.845182 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cacfc988-95e7-412b-805c-5c08de0a7fc9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:44.845600 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cacfc988-95e7-412b-805c-5c08de0a7fc9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:44.974897 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-cacfc988-95e7-412b-805c-5c08de0a7fc9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:44.982519 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-cacfc988-95e7-412b-805c-5c08de0a7fc9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1679 microversion: 2.1 time: 0.149358 Jun 29 12:36:44.983130 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 220/460] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:36:44 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:36:46.000009 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-bfe70490-f2e5-43a6-9adb-ab53a75625b6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:46.001229 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-bfe70490-f2e5-43a6-9adb-ab53a75625b6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:46.007252 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bfe70490-f2e5-43a6-9adb-ab53a75625b6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:46.007695 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bfe70490-f2e5-43a6-9adb-ab53a75625b6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:46.008441 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bfe70490-f2e5-43a6-9adb-ab53a75625b6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:46.008870 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bfe70490-f2e5-43a6-9adb-ab53a75625b6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:46.139619 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-bfe70490-f2e5-43a6-9adb-ab53a75625b6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:46.147390 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-bfe70490-f2e5-43a6-9adb-ab53a75625b6 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1679 microversion: 2.1 time: 0.151367 Jun 29 12:36:46.147955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 241/461] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:36:45 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:36:47.164239 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-310ae7b9-2c31-498e-b00a-dabf97fdd391 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:47.164825 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-310ae7b9-2c31-498e-b00a-dabf97fdd391 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:47.167303 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=32 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:36:47.172622 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-310ae7b9-2c31-498e-b00a-dabf97fdd391 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:47.173067 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-310ae7b9-2c31-498e-b00a-dabf97fdd391 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:47.173815 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-310ae7b9-2c31-498e-b00a-dabf97fdd391 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:47.174246 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-310ae7b9-2c31-498e-b00a-dabf97fdd391 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:47.301934 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-310ae7b9-2c31-498e-b00a-dabf97fdd391 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:47.309347 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-310ae7b9-2c31-498e-b00a-dabf97fdd391 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1679 microversion: 2.1 time: 0.148962 Jun 29 12:36:47.309902 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 221/462] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:36:47 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:36:48.326007 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-aa94c59e-c7ce-43f9-ae16-6871a2fc32d1 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:48.326687 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-aa94c59e-c7ce-43f9-ae16-6871a2fc32d1 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:48.332776 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aa94c59e-c7ce-43f9-ae16-6871a2fc32d1 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:48.333222 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aa94c59e-c7ce-43f9-ae16-6871a2fc32d1 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:48.333975 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aa94c59e-c7ce-43f9-ae16-6871a2fc32d1 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:48.334405 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aa94c59e-c7ce-43f9-ae16-6871a2fc32d1 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:48.464107 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-aa94c59e-c7ce-43f9-ae16-6871a2fc32d1 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:48.471616 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-aa94c59e-c7ce-43f9-ae16-6871a2fc32d1 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1679 microversion: 2.1 time: 0.149481 Jun 29 12:36:48.472178 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 242/463] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:36:48 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:36:49.488925 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8dd3b9c4-c2fe-4634-b07f-4dec89d997b9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:49.489562 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8dd3b9c4-c2fe-4634-b07f-4dec89d997b9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:49.496129 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8dd3b9c4-c2fe-4634-b07f-4dec89d997b9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:49.496579 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8dd3b9c4-c2fe-4634-b07f-4dec89d997b9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:49.497334 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8dd3b9c4-c2fe-4634-b07f-4dec89d997b9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:49.498372 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8dd3b9c4-c2fe-4634-b07f-4dec89d997b9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:49.626704 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8dd3b9c4-c2fe-4634-b07f-4dec89d997b9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:49.634093 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8dd3b9c4-c2fe-4634-b07f-4dec89d997b9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1679 microversion: 2.1 time: 0.148985 Jun 29 12:36:49.634676 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 222/464] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:36:49 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:36:50.651991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1ccb2982-50f7-4f03-8af6-e3d9a15d1c27 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:50.652596 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1ccb2982-50f7-4f03-8af6-e3d9a15d1c27 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:50.659691 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1ccb2982-50f7-4f03-8af6-e3d9a15d1c27 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:50.660136 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1ccb2982-50f7-4f03-8af6-e3d9a15d1c27 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:50.660890 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1ccb2982-50f7-4f03-8af6-e3d9a15d1c27 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:50.661327 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1ccb2982-50f7-4f03-8af6-e3d9a15d1c27 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:50.790307 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1ccb2982-50f7-4f03-8af6-e3d9a15d1c27 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:50.797756 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1ccb2982-50f7-4f03-8af6-e3d9a15d1c27 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1679 microversion: 2.1 time: 0.149571 Jun 29 12:36:50.798310 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 243/465] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:36:50 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:36:51.474819 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d21ecba6-8bdf-4aec-8eb4-c46c913286bb tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57c9cd4f-d05a-4d10-904d-34d8ffde5aa7"}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:36:51.475933 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d21ecba6-8bdf-4aec-8eb4-c46c913286bb tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:51.482939 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d21ecba6-8bdf-4aec-8eb4-c46c913286bb tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:51.483384 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d21ecba6-8bdf-4aec-8eb4-c46c913286bb tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:51.484128 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d21ecba6-8bdf-4aec-8eb4-c46c913286bb tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:51.484557 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d21ecba6-8bdf-4aec-8eb4-c46c913286bb tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:51.735093 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d21ecba6-8bdf-4aec-8eb4-c46c913286bb tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "POST /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264017 Jun 29 12:36:51.735716 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 223/466] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Jun 29 12:36:51 2022] POST /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:36:51.814634 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9fa5a528-8bb8-422a-893a-194e87ff4251 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:51.815243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-9fa5a528-8bb8-422a-893a-194e87ff4251 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:51.821301 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9fa5a528-8bb8-422a-893a-194e87ff4251 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:51.821799 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9fa5a528-8bb8-422a-893a-194e87ff4251 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:51.822598 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9fa5a528-8bb8-422a-893a-194e87ff4251 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:51.823022 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9fa5a528-8bb8-422a-893a-194e87ff4251 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:51.952522 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-9fa5a528-8bb8-422a-893a-194e87ff4251 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:51.959828 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-9fa5a528-8bb8-422a-893a-194e87ff4251 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1679 microversion: 2.1 time: 0.149143 Jun 29 12:36:51.960388 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 244/467] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:36:51 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:36:52.978472 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0818a357-46c6-4533-977b-2cb388c7df23 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:52.979116 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0818a357-46c6-4533-977b-2cb388c7df23 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:52.986465 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0818a357-46c6-4533-977b-2cb388c7df23 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:52.986920 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0818a357-46c6-4533-977b-2cb388c7df23 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:52.987681 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0818a357-46c6-4533-977b-2cb388c7df23 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:52.988119 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0818a357-46c6-4533-977b-2cb388c7df23 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:53.120039 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0818a357-46c6-4533-977b-2cb388c7df23 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:53.127494 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0818a357-46c6-4533-977b-2cb388c7df23 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1656 microversion: 2.1 time: 0.153788 Jun 29 12:36:53.128057 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 224/468] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:36:52 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1656 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:36:53.143757 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4e9bbe6b-75f0-428e-bc0d-88ac7772cc28 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:36:53.150035 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4e9bbe6b-75f0-428e-bc0d-88ac7772cc28 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:53.150518 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4e9bbe6b-75f0-428e-bc0d-88ac7772cc28 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:53.173065 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4e9bbe6b-75f0-428e-bc0d-88ac7772cc28 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Going to try to start instance {{(pid=124317) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 29 12:36:53.212176 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4e9bbe6b-75f0-428e-bc0d-88ac7772cc28 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "POST /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4/action" status: 202 len: 0 microversion: 2.1 time: 0.072057 Jun 29 12:36:53.212770 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 245/469] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 12:36:53 2022] POST /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 29 12:36:53.221489 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a576dd5a-aef8-4284-bb53-c9480b1a98b0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:53.222101 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a576dd5a-aef8-4284-bb53-c9480b1a98b0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:53.228061 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a576dd5a-aef8-4284-bb53-c9480b1a98b0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:53.228560 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a576dd5a-aef8-4284-bb53-c9480b1a98b0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:53.229300 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a576dd5a-aef8-4284-bb53-c9480b1a98b0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:53.229727 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a576dd5a-aef8-4284-bb53-c9480b1a98b0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:53.398017 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-a576dd5a-aef8-4284-bb53-c9480b1a98b0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:53.405955 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a576dd5a-aef8-4284-bb53-c9480b1a98b0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1665 microversion: 2.1 time: 0.188354 Jun 29 12:36:53.406546 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 225/470] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:36:53 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1665 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:36:54.425215 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-759ea272-96f1-431e-abd2-d8441eb82cd0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:54.425909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-759ea272-96f1-431e-abd2-d8441eb82cd0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:54.432048 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-759ea272-96f1-431e-abd2-d8441eb82cd0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:54.432492 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-759ea272-96f1-431e-abd2-d8441eb82cd0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:54.433235 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-759ea272-96f1-431e-abd2-d8441eb82cd0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:54.433665 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-759ea272-96f1-431e-abd2-d8441eb82cd0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:54.814803 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-759ea272-96f1-431e-abd2-d8441eb82cd0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:54.822241 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-759ea272-96f1-431e-abd2-d8441eb82cd0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1665 microversion: 2.1 time: 0.401728 Jun 29 12:36:54.822840 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 246/471] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:36:54 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1665 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:36:55.839410 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-bb0c6e40-0909-4d63-8525-66e643e491aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:55.840051 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-bb0c6e40-0909-4d63-8525-66e643e491aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:55.847186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bb0c6e40-0909-4d63-8525-66e643e491aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:55.847635 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bb0c6e40-0909-4d63-8525-66e643e491aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:55.848389 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bb0c6e40-0909-4d63-8525-66e643e491aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:55.848858 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bb0c6e40-0909-4d63-8525-66e643e491aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:55.980311 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-bb0c6e40-0909-4d63-8525-66e643e491aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:55.988078 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-bb0c6e40-0909-4d63-8525-66e643e491aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1669 microversion: 2.1 time: 0.152534 Jun 29 12:36:55.988637 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 226/472] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:36:55 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:36:59.227132 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a210fc77-2c8a-4376-bb94-02d04c677f47 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:36:59.228121 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a210fc77-2c8a-4376-bb94-02d04c677f47 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:59.234745 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a210fc77-2c8a-4376-bb94-02d04c677f47 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:59.235185 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a210fc77-2c8a-4376-bb94-02d04c677f47 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:59.235928 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a210fc77-2c8a-4376-bb94-02d04c677f47 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:59.236358 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a210fc77-2c8a-4376-bb94-02d04c677f47 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:59.258182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-a210fc77-2c8a-4376-bb94-02d04c677f47 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lazy-loading 'flavor' on Instance uuid 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 12:36:59.378500 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a210fc77-2c8a-4376-bb94-02d04c677f47 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "POST /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c/action" status: 200 len: 32 microversion: 2.1 time: 0.155300 Jun 29 12:36:59.379021 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 247/473] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 12:36:59 2022] POST /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c/action => generated 32 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 12:36:59.388085 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-56762efd-0fa6-4a9b-91b9-2a2d4ab25405 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:36:59.389255 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-56762efd-0fa6-4a9b-91b9-2a2d4ab25405 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:36:59.395630 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-56762efd-0fa6-4a9b-91b9-2a2d4ab25405 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:59.396110 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-56762efd-0fa6-4a9b-91b9-2a2d4ab25405 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:59.396838 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-56762efd-0fa6-4a9b-91b9-2a2d4ab25405 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:36:59.397274 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-56762efd-0fa6-4a9b-91b9-2a2d4ab25405 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:36:59.612386 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-56762efd-0fa6-4a9b-91b9-2a2d4ab25405 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:36:59.620460 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-56762efd-0fa6-4a9b-91b9-2a2d4ab25405 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1737 microversion: 2.1 time: 0.236204 Jun 29 12:36:59.621022 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 227/474] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:36:59 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1737 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:00.637962 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-89a19cd2-129a-43ee-89a3-766f6d13334a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:00.639236 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-89a19cd2-129a-43ee-89a3-766f6d13334a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:00.641159 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=32 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:37:00.647027 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-89a19cd2-129a-43ee-89a3-766f6d13334a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:00.647471 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-89a19cd2-129a-43ee-89a3-766f6d13334a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:00.648228 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-89a19cd2-129a-43ee-89a3-766f6d13334a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:00.648785 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-89a19cd2-129a-43ee-89a3-766f6d13334a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:00.776227 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-89a19cd2-129a-43ee-89a3-766f6d13334a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:00.784274 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-89a19cd2-129a-43ee-89a3-766f6d13334a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1737 microversion: 2.1 time: 0.150609 Jun 29 12:37:00.784864 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 248/475] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:00 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:01.801311 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-81912ee2-8e39-4f89-96cf-0b90ff0d1022 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:01.801962 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-81912ee2-8e39-4f89-96cf-0b90ff0d1022 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:01.808451 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-81912ee2-8e39-4f89-96cf-0b90ff0d1022 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:01.808900 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-81912ee2-8e39-4f89-96cf-0b90ff0d1022 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:01.809656 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-81912ee2-8e39-4f89-96cf-0b90ff0d1022 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:01.810533 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-81912ee2-8e39-4f89-96cf-0b90ff0d1022 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:01.940183 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-81912ee2-8e39-4f89-96cf-0b90ff0d1022 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:01.947984 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-81912ee2-8e39-4f89-96cf-0b90ff0d1022 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1737 microversion: 2.1 time: 0.150560 Jun 29 12:37:01.948567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 228/476] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:01 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:02.965139 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-121fcf1a-e2a6-45c6-9ae6-4e2845a6c1f5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:02.965686 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-121fcf1a-e2a6-45c6-9ae6-4e2845a6c1f5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:02.972478 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-121fcf1a-e2a6-45c6-9ae6-4e2845a6c1f5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:02.972923 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-121fcf1a-e2a6-45c6-9ae6-4e2845a6c1f5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:02.973707 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-121fcf1a-e2a6-45c6-9ae6-4e2845a6c1f5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:02.974137 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-121fcf1a-e2a6-45c6-9ae6-4e2845a6c1f5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:03.102722 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-121fcf1a-e2a6-45c6-9ae6-4e2845a6c1f5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:03.111195 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-121fcf1a-e2a6-45c6-9ae6-4e2845a6c1f5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1737 microversion: 2.1 time: 0.149946 Jun 29 12:37:03.111849 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 249/477] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:02 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:04.128980 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-053ce15f-9d36-4d25-8bf0-d7553d406f65 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:04.129591 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-053ce15f-9d36-4d25-8bf0-d7553d406f65 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:04.136030 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-053ce15f-9d36-4d25-8bf0-d7553d406f65 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:04.136481 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-053ce15f-9d36-4d25-8bf0-d7553d406f65 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:04.137249 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-053ce15f-9d36-4d25-8bf0-d7553d406f65 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:04.137687 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-053ce15f-9d36-4d25-8bf0-d7553d406f65 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:04.268015 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-053ce15f-9d36-4d25-8bf0-d7553d406f65 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:04.276258 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-053ce15f-9d36-4d25-8bf0-d7553d406f65 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1737 microversion: 2.1 time: 0.151126 Jun 29 12:37:04.276819 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 229/478] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:04 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:05.293775 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-7b51de45-7963-448d-b997-2318f6ca8764 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:05.294566 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-7b51de45-7963-448d-b997-2318f6ca8764 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:05.300521 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7b51de45-7963-448d-b997-2318f6ca8764 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:05.300969 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7b51de45-7963-448d-b997-2318f6ca8764 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:05.301722 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7b51de45-7963-448d-b997-2318f6ca8764 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:05.302155 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7b51de45-7963-448d-b997-2318f6ca8764 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:05.429822 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7b51de45-7963-448d-b997-2318f6ca8764 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:05.438346 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-7b51de45-7963-448d-b997-2318f6ca8764 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1737 microversion: 2.1 time: 0.148413 Jun 29 12:37:05.438935 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 250/479] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:05 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:06.456543 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b10ceb9a-0383-4250-897e-deb7ab9d9c78 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:06.457168 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b10ceb9a-0383-4250-897e-deb7ab9d9c78 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:06.463585 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b10ceb9a-0383-4250-897e-deb7ab9d9c78 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:06.464027 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b10ceb9a-0383-4250-897e-deb7ab9d9c78 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:06.464787 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b10ceb9a-0383-4250-897e-deb7ab9d9c78 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:06.465213 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b10ceb9a-0383-4250-897e-deb7ab9d9c78 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:06.592488 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b10ceb9a-0383-4250-897e-deb7ab9d9c78 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:06.600273 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b10ceb9a-0383-4250-897e-deb7ab9d9c78 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1737 microversion: 2.1 time: 0.147995 Jun 29 12:37:06.600833 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 230/480] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:06 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:07.617983 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4e4f6960-69ab-4033-8315-389b5db3923f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:07.618533 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4e4f6960-69ab-4033-8315-389b5db3923f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:07.624422 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4e4f6960-69ab-4033-8315-389b5db3923f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:07.624861 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4e4f6960-69ab-4033-8315-389b5db3923f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:07.625634 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4e4f6960-69ab-4033-8315-389b5db3923f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:07.626068 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4e4f6960-69ab-4033-8315-389b5db3923f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:07.643686 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:37:07.755167 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4e4f6960-69ab-4033-8315-389b5db3923f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:07.763865 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4e4f6960-69ab-4033-8315-389b5db3923f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1737 microversion: 2.1 time: 0.149048 Jun 29 12:37:07.764428 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 251/481] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:07 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:08.782117 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-05b816be-6931-4792-9197-bdec2ee6917a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:08.782759 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-05b816be-6931-4792-9197-bdec2ee6917a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:08.789212 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-05b816be-6931-4792-9197-bdec2ee6917a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:08.789660 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-05b816be-6931-4792-9197-bdec2ee6917a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:08.790416 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-05b816be-6931-4792-9197-bdec2ee6917a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:08.790875 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-05b816be-6931-4792-9197-bdec2ee6917a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:09.152364 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-05b816be-6931-4792-9197-bdec2ee6917a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:09.160720 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-05b816be-6931-4792-9197-bdec2ee6917a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1737 microversion: 2.1 time: 0.383522 Jun 29 12:37:09.161275 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 231/482] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:08 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1737 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:10.179245 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8d1a3ebf-bcfa-4a1e-bb88-e15ae4925c26 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:10.179849 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8d1a3ebf-bcfa-4a1e-bb88-e15ae4925c26 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:10.186227 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8d1a3ebf-bcfa-4a1e-bb88-e15ae4925c26 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:10.187367 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8d1a3ebf-bcfa-4a1e-bb88-e15ae4925c26 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:10.188236 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8d1a3ebf-bcfa-4a1e-bb88-e15ae4925c26 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:10.188668 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8d1a3ebf-bcfa-4a1e-bb88-e15ae4925c26 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:10.331129 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8d1a3ebf-bcfa-4a1e-bb88-e15ae4925c26 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:10.338954 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8d1a3ebf-bcfa-4a1e-bb88-e15ae4925c26 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1737 microversion: 2.1 time: 0.163739 Jun 29 12:37:10.339507 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 252/483] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:10 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:11.356077 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a9468306-9485-4e92-a344-30902bc1e714 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:11.356680 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a9468306-9485-4e92-a344-30902bc1e714 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:11.363837 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a9468306-9485-4e92-a344-30902bc1e714 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:11.364283 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a9468306-9485-4e92-a344-30902bc1e714 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:11.365052 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a9468306-9485-4e92-a344-30902bc1e714 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:11.365480 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a9468306-9485-4e92-a344-30902bc1e714 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:11.380606 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:37:11.509112 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-a9468306-9485-4e92-a344-30902bc1e714 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:11.517800 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a9468306-9485-4e92-a344-30902bc1e714 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1737 microversion: 2.1 time: 0.165464 Jun 29 12:37:11.518287 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 232/484] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:11 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:12.535388 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-244ab456-8024-40e3-b7eb-0083a5551493 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:12.535983 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-244ab456-8024-40e3-b7eb-0083a5551493 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:12.541892 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-244ab456-8024-40e3-b7eb-0083a5551493 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:12.542331 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-244ab456-8024-40e3-b7eb-0083a5551493 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:12.543115 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-244ab456-8024-40e3-b7eb-0083a5551493 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:12.543546 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-244ab456-8024-40e3-b7eb-0083a5551493 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:12.673704 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-244ab456-8024-40e3-b7eb-0083a5551493 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:12.681613 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-244ab456-8024-40e3-b7eb-0083a5551493 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1737 microversion: 2.1 time: 0.150037 Jun 29 12:37:12.682185 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 253/485] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:12 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:13.698652 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f43c2790-fdeb-409f-8cd6-b709cc05cb0e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:13.699175 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f43c2790-fdeb-409f-8cd6-b709cc05cb0e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:13.705822 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f43c2790-fdeb-409f-8cd6-b709cc05cb0e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:13.706268 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f43c2790-fdeb-409f-8cd6-b709cc05cb0e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:13.707044 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f43c2790-fdeb-409f-8cd6-b709cc05cb0e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:13.707478 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f43c2790-fdeb-409f-8cd6-b709cc05cb0e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:13.833049 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f43c2790-fdeb-409f-8cd6-b709cc05cb0e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:13.840874 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f43c2790-fdeb-409f-8cd6-b709cc05cb0e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1717 microversion: 2.1 time: 0.146177 Jun 29 12:37:13.841429 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 233/486] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:13 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1717 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:13.942892 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b154af76-9667-44c8-8421-2a680cbbdd4e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:13.943421 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b154af76-9667-44c8-8421-2a680cbbdd4e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:13.949364 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b154af76-9667-44c8-8421-2a680cbbdd4e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:13.949744 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b154af76-9667-44c8-8421-2a680cbbdd4e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:13.950518 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b154af76-9667-44c8-8421-2a680cbbdd4e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:13.950949 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b154af76-9667-44c8-8421-2a680cbbdd4e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:14.029896 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-b154af76-9667-44c8-8421-2a680cbbdd4e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] HTTP exception thrown: Cannot 'detach_volume' instance 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c while it is in vm_state rescued Jun 29 12:37:14.032060 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b154af76-9667-44c8-8421-2a680cbbdd4e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Request method failure captured: Jun 29 12:37:14.032060 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: DELETE /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c/os-volume_attachments/57c9cd4f-d05a-4d10-904d-34d8ffde5aa7 HTTP/1.1 Jun 29 12:37:14.032060 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:37:14.032060 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:37:14.032060 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:37:14.032060 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:37:14.032060 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:37:14.032060 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:37:14.032060 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:37:14.032060 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:37:14.032060 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEabg5iVMEbOJzCwdOCwPxnKhRE8xvAH6FjMNwILYHvgdAsYTJbCxQBGWRog2gvt81PgL8lF8nPUVAT6C20WS8IP2YDtPNfSU3z3-biFYl82u8OpR9Rn0KOwxc725AZY3ac1c00Qu2nph6va0WgPmO9r1VgnqYNalOsYrn_-l7oCAZY Jun 29 12:37:14.032060 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:37:14.032060 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:37:14.032060 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:37:14.032060 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:37:14.032060 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:37:14.032060 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:37:14.032060 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: 8be6d4a4e2344e25b7661d69a9e222c8 Jun 29 12:37:14.032060 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-117238858 Jun 29 12:37:14.032060 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:37:14.032060 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:37:14.033596 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8be6d4a4e2344e25b7661d69a9e222c8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8be6d4a4e2344e25b7661d69a9e222c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8be6d4a4e2344e25b7661d69a9e222c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8be6d4a4e2344e25b7661d69a9e222c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:37:14.033596 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-ServerRescueNegativeTestJSON-117238858 Jun 29 12:37:14.033596 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 8be6d4a4e2344e25b7661d69a9e222c8 Jun 29 12:37:14.033596 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-117238858 Jun 29 12:37:14.033596 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-ServerRescueNegativeTestJSON-117238858-project Jun 29 12:37:14.033596 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:37:14.033596 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:37:14.033596 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: 350a57ee307a4419974dcecf37e466e5 Jun 29 12:37:14.033596 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-ServerRescueNegativeTestJSON-117238858-project Jun 29 12:37:14.033596 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:37:14.033596 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Cannot 'detach_volume' instance 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c while it is in vm_state rescued Jun 29 12:37:14.034351 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'server_id': '44f2e3f4-c3b9-44d5-9648-2a68acec3d2c', 'id': '57c9cd4f-d05a-4d10-904d-34d8ffde5aa7'} Jun 29 12:37:14.034351 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:37:14.034351 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:37:14.034351 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 12:37:14.034351 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 12:37:14.034351 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 12:37:14.034351 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 12:37:14.034351 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 29 12:37:14.034351 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 29 12:37:14.034351 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 29 12:37:14.034351 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:37:14.034351 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:37:14.034351 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:37:14.034351 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:37:14.034351 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:37:14.034351 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:37:14.034351 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:37:14.034351 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:37:14.034351 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:37:14.034351 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:37:14.036017 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 29 12:37:14.036017 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 29 12:37:14.036017 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 29 12:37:14.036017 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 29 12:37:14.036017 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c while it is in vm_state rescued Jun 29 12:37:14.036017 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:37:14.036017 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:37:14.036017 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:37:14.036017 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:37:14.036017 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:37:14.036017 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:37:14.036017 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:37:14.036017 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:37:14.036017 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c while it is in vm_state rescued Jun 29 12:37:14.036017 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:37:14.036017 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b154af76-9667-44c8-8421-2a680cbbdd4e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Returning 409 to user: Cannot 'detach_volume' instance 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c while it is in vm_state rescued {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:37:14.037274 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b154af76-9667-44c8-8421-2a680cbbdd4e tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "DELETE /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c/os-volume_attachments/57c9cd4f-d05a-4d10-904d-34d8ffde5aa7" status: 409 len: 152 microversion: 2.1 time: 0.094487 Jun 29 12:37:14.037274 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 254/487] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 12:37:13 2022] DELETE /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c/os-volume_attachments/57c9cd4f-d05a-4d10-904d-34d8ffde5aa7 => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 29 12:37:14.042866 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e777b89d-e8b1-400e-b7b7-2f2fadc29a34 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:37:14.043409 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e777b89d-e8b1-400e-b7b7-2f2fadc29a34 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:14.050197 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e777b89d-e8b1-400e-b7b7-2f2fadc29a34 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:14.050697 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e777b89d-e8b1-400e-b7b7-2f2fadc29a34 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:14.051467 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e777b89d-e8b1-400e-b7b7-2f2fadc29a34 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:14.051904 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e777b89d-e8b1-400e-b7b7-2f2fadc29a34 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:14.117753 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e777b89d-e8b1-400e-b7b7-2f2fadc29a34 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "POST /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c/action" status: 202 len: 0 microversion: 2.1 time: 0.078500 Jun 29 12:37:14.118373 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 234/488] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 12:37:14 2022] POST /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:37:14.127025 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c652016d-9790-41aa-b311-2f0db4c16fbd tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:14.127718 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c652016d-9790-41aa-b311-2f0db4c16fbd tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:14.133883 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c652016d-9790-41aa-b311-2f0db4c16fbd tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:14.134493 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c652016d-9790-41aa-b311-2f0db4c16fbd tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:14.135294 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c652016d-9790-41aa-b311-2f0db4c16fbd tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:14.135742 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c652016d-9790-41aa-b311-2f0db4c16fbd tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:14.271279 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c652016d-9790-41aa-b311-2f0db4c16fbd tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:14.279307 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c652016d-9790-41aa-b311-2f0db4c16fbd tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1725 microversion: 2.1 time: 0.156708 Jun 29 12:37:14.279857 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 255/489] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:14 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:15.298870 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2a4a2f69-6021-490c-88c1-f066047fc76f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:15.299632 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2a4a2f69-6021-490c-88c1-f066047fc76f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:15.305824 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2a4a2f69-6021-490c-88c1-f066047fc76f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:15.306269 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2a4a2f69-6021-490c-88c1-f066047fc76f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:15.307049 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2a4a2f69-6021-490c-88c1-f066047fc76f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:15.307489 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2a4a2f69-6021-490c-88c1-f066047fc76f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:15.439214 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2a4a2f69-6021-490c-88c1-f066047fc76f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:15.446951 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2a4a2f69-6021-490c-88c1-f066047fc76f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1725 microversion: 2.1 time: 0.153567 Jun 29 12:37:15.447500 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 235/490] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:15 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:16.464117 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a8399917-5511-49c6-b23b-b5e96ca9859a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:16.464717 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a8399917-5511-49c6-b23b-b5e96ca9859a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:16.471423 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a8399917-5511-49c6-b23b-b5e96ca9859a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:16.471865 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a8399917-5511-49c6-b23b-b5e96ca9859a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:16.472609 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a8399917-5511-49c6-b23b-b5e96ca9859a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:16.473037 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a8399917-5511-49c6-b23b-b5e96ca9859a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:16.599797 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a8399917-5511-49c6-b23b-b5e96ca9859a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:16.607728 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a8399917-5511-49c6-b23b-b5e96ca9859a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1725 microversion: 2.1 time: 0.147437 Jun 29 12:37:16.609389 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 256/491] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:16 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:17.626195 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-304ae5ae-e58c-470f-8db6-3b37676c53ee tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:17.626778 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-304ae5ae-e58c-470f-8db6-3b37676c53ee tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:17.629188 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=30 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:37:17.634387 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-304ae5ae-e58c-470f-8db6-3b37676c53ee tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:17.634862 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-304ae5ae-e58c-470f-8db6-3b37676c53ee tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:17.635617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-304ae5ae-e58c-470f-8db6-3b37676c53ee tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:17.636045 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-304ae5ae-e58c-470f-8db6-3b37676c53ee tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:17.768742 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-304ae5ae-e58c-470f-8db6-3b37676c53ee tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:17.776915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-304ae5ae-e58c-470f-8db6-3b37676c53ee tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1731 microversion: 2.1 time: 0.154880 Jun 29 12:37:17.777473 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 236/492] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:17 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:17.793366 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a2d3f1f2-7253-418d-834b-ff7f99d8b4fc tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:17.793866 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a2d3f1f2-7253-418d-834b-ff7f99d8b4fc tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:17.799914 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a2d3f1f2-7253-418d-834b-ff7f99d8b4fc tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:17.800356 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a2d3f1f2-7253-418d-834b-ff7f99d8b4fc tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:17.801100 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a2d3f1f2-7253-418d-834b-ff7f99d8b4fc tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:17.801533 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a2d3f1f2-7253-418d-834b-ff7f99d8b4fc tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:17.879559 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a2d3f1f2-7253-418d-834b-ff7f99d8b4fc tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089943 Jun 29 12:37:17.880175 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 257/493] 10.222.0.52 () {58 vars in 1274 bytes} [Wed Jun 29 12:37:17 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:37:18.761997 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-546397b3-5c14-456e-8fe2-5e2c2b623bcf req-3b6405f1-cbc8-43a8-b720-fd07656a69c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44f2e3f4-c3b9-44d5-9648-2a68acec3d2c", "tag": "e0d184c2-5cac-4f0e-a86b-473ab610d153"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:37:18.772320 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-546397b3-5c14-456e-8fe2-5e2c2b623bcf req-3b6405f1-cbc8-43a8-b720-fd07656a69c5 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:18.772762 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-546397b3-5c14-456e-8fe2-5e2c2b623bcf req-3b6405f1-cbc8-43a8-b720-fd07656a69c5 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:18.784721 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-546397b3-5c14-456e-8fe2-5e2c2b623bcf req-3b6405f1-cbc8-43a8-b720-fd07656a69c5 service nova] Creating event network-changed:e0d184c2-5cac-4f0e-a86b-473ab610d153 for instance 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c on hv-cinder-81268 Jun 29 12:37:18.789882 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-546397b3-5c14-456e-8fe2-5e2c2b623bcf req-3b6405f1-cbc8-43a8-b720-fd07656a69c5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031492 Jun 29 12:37:18.790736 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 237/494] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:37:20.805697 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-f9b559c2-eaa3-4fb0-87a2-55a0a905bea9 req-51149710-515d-4b14-9135-9b063b690745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44f2e3f4-c3b9-44d5-9648-2a68acec3d2c", "tag": "e0d184c2-5cac-4f0e-a86b-473ab610d153"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:37:20.814323 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-f9b559c2-eaa3-4fb0-87a2-55a0a905bea9 req-51149710-515d-4b14-9135-9b063b690745 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:20.814786 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-f9b559c2-eaa3-4fb0-87a2-55a0a905bea9 req-51149710-515d-4b14-9135-9b063b690745 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:20.825394 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-f9b559c2-eaa3-4fb0-87a2-55a0a905bea9 req-51149710-515d-4b14-9135-9b063b690745 service nova] Creating event network-changed:e0d184c2-5cac-4f0e-a86b-473ab610d153 for instance 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c on hv-cinder-81268 Jun 29 12:37:20.830906 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-f9b559c2-eaa3-4fb0-87a2-55a0a905bea9 req-51149710-515d-4b14-9135-9b063b690745 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028977 Jun 29 12:37:20.831474 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 258/495] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:37:21.657561 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d05a4149-b1eb-4b3c-98cc-a262e935e0c1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:21.658064 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d05a4149-b1eb-4b3c-98cc-a262e935e0c1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:21.664860 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d05a4149-b1eb-4b3c-98cc-a262e935e0c1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:21.665304 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d05a4149-b1eb-4b3c-98cc-a262e935e0c1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:21.666055 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d05a4149-b1eb-4b3c-98cc-a262e935e0c1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:21.666519 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d05a4149-b1eb-4b3c-98cc-a262e935e0c1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:21.698330 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d05a4149-b1eb-4b3c-98cc-a262e935e0c1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86/os-volume_attachments/5280dbbe-7840-4047-b223-5863efb38f3c" status: 200 len: 194 microversion: 2.20 time: 0.045185 Jun 29 12:37:21.698954 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 238/496] 10.222.0.52 () {60 vars in 1453 bytes} [Wed Jun 29 12:37:21 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86/os-volume_attachments/5280dbbe-7840-4047-b223-5863efb38f3c => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 12:37:21.761034 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e63efc43-cdcf-4d26-ac18-6060905d1694 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:21.761606 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e63efc43-cdcf-4d26-ac18-6060905d1694 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:21.768720 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e63efc43-cdcf-4d26-ac18-6060905d1694 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:21.769162 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e63efc43-cdcf-4d26-ac18-6060905d1694 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:21.769901 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e63efc43-cdcf-4d26-ac18-6060905d1694 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:21.770622 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e63efc43-cdcf-4d26-ac18-6060905d1694 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:21.848245 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-e63efc43-cdcf-4d26-ac18-6060905d1694 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lazy-loading 'services' on Instance uuid d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 12:37:21.917168 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e63efc43-cdcf-4d26-ac18-6060905d1694 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86/os-volume_attachments/5280dbbe-7840-4047-b223-5863efb38f3c" status: 202 len: 0 microversion: 2.20 time: 0.160141 Jun 29 12:37:21.917767 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 259/497] 10.222.0.52 () {60 vars in 1456 bytes} [Wed Jun 29 12:37:21 2022] DELETE /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86/os-volume_attachments/5280dbbe-7840-4047-b223-5863efb38f3c => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 29 12:37:21.926881 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5440dd57-fd41-4697-bd0f-a0af09d6d2b3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:21.927894 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5440dd57-fd41-4697-bd0f-a0af09d6d2b3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:21.933878 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5440dd57-fd41-4697-bd0f-a0af09d6d2b3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:21.934325 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5440dd57-fd41-4697-bd0f-a0af09d6d2b3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:21.935136 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5440dd57-fd41-4697-bd0f-a0af09d6d2b3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:21.935554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5440dd57-fd41-4697-bd0f-a0af09d6d2b3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:21.966657 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5440dd57-fd41-4697-bd0f-a0af09d6d2b3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043724 Jun 29 12:37:21.967202 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 239/498] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 12:37:21 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 12:37:22.979410 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-adbf9953-be35-4b70-bfb5-aca6ff17411a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:22.980403 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-adbf9953-be35-4b70-bfb5-aca6ff17411a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:22.987184 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-adbf9953-be35-4b70-bfb5-aca6ff17411a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:22.987636 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-adbf9953-be35-4b70-bfb5-aca6ff17411a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:22.988369 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-adbf9953-be35-4b70-bfb5-aca6ff17411a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:22.988792 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-adbf9953-be35-4b70-bfb5-aca6ff17411a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:23.016997 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-adbf9953-be35-4b70-bfb5-aca6ff17411a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042126 Jun 29 12:37:23.017533 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 260/499] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 12:37:22 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:23.073283 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-058d595e-0365-4519-a297-ab6d3c07ad21 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:23.073829 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-058d595e-0365-4519-a297-ab6d3c07ad21 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:23.080357 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-058d595e-0365-4519-a297-ab6d3c07ad21 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:23.080811 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-058d595e-0365-4519-a297-ab6d3c07ad21 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:23.081578 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-058d595e-0365-4519-a297-ab6d3c07ad21 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:23.082020 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-058d595e-0365-4519-a297-ab6d3c07ad21 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:23.107102 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-058d595e-0365-4519-a297-ab6d3c07ad21 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 12:37:23.180700 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-058d595e-0365-4519-a297-ab6d3c07ad21 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 204 len: 0 microversion: 2.20 time: 0.110985 Jun 29 12:37:23.181368 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 240/500] 10.222.0.52 () {60 vars in 1279 bytes} [Wed Jun 29 12:37:23 2022] DELETE /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 29 12:37:23.190317 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-79e05eb8-3aa5-4ca0-ba22-32a70b67fc4e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:23.190983 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-79e05eb8-3aa5-4ca0-ba22-32a70b67fc4e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:23.196935 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-79e05eb8-3aa5-4ca0-ba22-32a70b67fc4e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:23.197381 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-79e05eb8-3aa5-4ca0-ba22-32a70b67fc4e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:23.198126 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-79e05eb8-3aa5-4ca0-ba22-32a70b67fc4e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:23.198588 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-79e05eb8-3aa5-4ca0-ba22-32a70b67fc4e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:23.333957 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-79e05eb8-3aa5-4ca0-ba22-32a70b67fc4e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:23.341755 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-79e05eb8-3aa5-4ca0-ba22-32a70b67fc4e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:23.343940 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-79e05eb8-3aa5-4ca0-ba22-32a70b67fc4e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:23.345081 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-79e05eb8-3aa5-4ca0-ba22-32a70b67fc4e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1722 microversion: 2.20 time: 0.159237 Jun 29 12:37:23.345630 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 261/501] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:37:23 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:37:24.364144 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-cfef5203-45ba-4e55-9294-e3fc00916230 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:24.365186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-cfef5203-45ba-4e55-9294-e3fc00916230 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:24.371242 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cfef5203-45ba-4e55-9294-e3fc00916230 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:24.371685 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cfef5203-45ba-4e55-9294-e3fc00916230 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:24.372439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cfef5203-45ba-4e55-9294-e3fc00916230 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:24.372871 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cfef5203-45ba-4e55-9294-e3fc00916230 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:24.507107 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-cfef5203-45ba-4e55-9294-e3fc00916230 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:24.515252 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-cfef5203-45ba-4e55-9294-e3fc00916230 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:24.516735 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-cfef5203-45ba-4e55-9294-e3fc00916230 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:24.517874 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-cfef5203-45ba-4e55-9294-e3fc00916230 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1722 microversion: 2.20 time: 0.158000 Jun 29 12:37:24.518437 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 241/502] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:37:24 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:37:25.536362 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ba064131-cadc-4ca3-818c-26d231823efa tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:25.537088 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ba064131-cadc-4ca3-818c-26d231823efa tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:25.543024 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ba064131-cadc-4ca3-818c-26d231823efa tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:25.543474 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ba064131-cadc-4ca3-818c-26d231823efa tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:25.544239 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ba064131-cadc-4ca3-818c-26d231823efa tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:25.544673 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ba064131-cadc-4ca3-818c-26d231823efa tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:25.616091 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ba064131-cadc-4ca3-818c-26d231823efa tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:25.618136 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-e53ed3ff-8b91-484c-9463-c4aeaf110340 req-23ff6d86-3ff6-49a7-96d0-0899d99b8bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d615c3d2-4ba0-41e9-be7e-8e51d8e36b86", "name": "network-vif-deleted", "tag": "c73e8ec9-3797-428f-82d9-0808363d1eab"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:37:25.627872 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ba064131-cadc-4ca3-818c-26d231823efa tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:25.630294 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ba064131-cadc-4ca3-818c-26d231823efa tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:25.631510 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ba064131-cadc-4ca3-818c-26d231823efa tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 200 len: 1654 microversion: 2.20 time: 0.099581 Jun 29 12:37:25.632731 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 262/503] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:37:25 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 1654 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:37:25.644854 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-e53ed3ff-8b91-484c-9463-c4aeaf110340 req-23ff6d86-3ff6-49a7-96d0-0899d99b8bf6 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:25.646315 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-e53ed3ff-8b91-484c-9463-c4aeaf110340 req-23ff6d86-3ff6-49a7-96d0-0899d99b8bf6 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:25.665043 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-e53ed3ff-8b91-484c-9463-c4aeaf110340 req-23ff6d86-3ff6-49a7-96d0-0899d99b8bf6 service nova] Creating event network-vif-deleted:c73e8ec9-3797-428f-82d9-0808363d1eab for instance d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 on hv-cinder-81268 Jun 29 12:37:25.671848 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-e53ed3ff-8b91-484c-9463-c4aeaf110340 req-23ff6d86-3ff6-49a7-96d0-0899d99b8bf6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056438 Jun 29 12:37:25.674383 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 242/504] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:37:26.652544 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a89720dc-02b9-4ca4-b771-e2073a3a6a4a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:26.653149 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a89720dc-02b9-4ca4-b771-e2073a3a6a4a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:26.659919 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a89720dc-02b9-4ca4-b771-e2073a3a6a4a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:26.660759 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a89720dc-02b9-4ca4-b771-e2073a3a6a4a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:26.661320 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a89720dc-02b9-4ca4-b771-e2073a3a6a4a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:26.661816 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a89720dc-02b9-4ca4-b771-e2073a3a6a4a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:26.681474 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-a89720dc-02b9-4ca4-b771-e2073a3a6a4a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] HTTP exception thrown: Instance d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 could not be found. Jun 29 12:37:26.683251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a89720dc-02b9-4ca4-b771-e2073a3a6a4a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Request method failure captured: Jun 29 12:37:26.683251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 HTTP/1.1 Jun 29 12:37:26.683251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:37:26.683251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:37:26.683251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:37:26.683251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:37:26.683251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:37:26.683251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:37:26.683251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:37:26.683251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:37:26.683251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEaSW5D-CqEu29RVBGKm9IlqDK1jdGTv6OTojemrW-D2tajaadA5m5XiLrdimXj1PsJ0rWVBy6y3eVdvkOLNkwyWS8hT_HXhLScyJIUV6nVaQgGHeYsf2E4AYFv4d8NTzSuOA6Nv4uz_0tXpA7AfmubyVOX1nTpaDJUy-fSvZ8DINWo Jun 29 12:37:26.683251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:37:26.683251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:37:26.683251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:37:26.683251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:37:26.683251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 12:37:26.683251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:37:26.683251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:37:26.683251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: 0ed882ae485441db99ccf6109be51b22 Jun 29 12:37:26.683251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-211799616 Jun 29 12:37:26.683251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:37:26.683251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:37:26.684691 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0ed882ae485441db99ccf6109be51b22", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0ed882ae485441db99ccf6109be51b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ed882ae485441db99ccf6109be51b22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ed882ae485441db99ccf6109be51b22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:37:26.684691 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeShelveTestJSON-211799616 Jun 29 12:37:26.684691 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 0ed882ae485441db99ccf6109be51b22 Jun 29 12:37:26.684691 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-211799616 Jun 29 12:37:26.684691 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeShelveTestJSON-211799616-project Jun 29 12:37:26.684691 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:37:26.684691 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:37:26.684691 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: 6252d0519ed9421e89710ca5294524c5 Jun 29 12:37:26.684691 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeShelveTestJSON-211799616-project Jun 29 12:37:26.684691 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:37:26.684691 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Instance d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 could not be found. Jun 29 12:37:26.684691 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': 'd615c3d2-4ba0-41e9-be7e-8e51d8e36b86'} Jun 29 12:37:26.685476 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:37:26.685476 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:37:26.685476 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:37:26.685476 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:37:26.685476 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:37:26.685476 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:37:26.685476 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:37:26.685476 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:37:26.685476 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:37:26.685476 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:37:26.685476 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 could not be found. Jun 29 12:37:26.685476 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:37:26.685476 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:37:26.685476 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:37:26.685476 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:37:26.685476 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:37:26.685476 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:37:26.685476 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:37:26.685476 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:37:26.685476 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:37:26.688859 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:37:26.688859 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:37:26.688859 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:37:26.688859 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:37:26.688859 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:37:26.688859 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:37:26.688859 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:37:26.688859 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 could not be found. Jun 29 12:37:26.688859 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:37:26.688859 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:37:26.688859 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:37:26.688859 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:37:26.688859 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:37:26.688859 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:37:26.688859 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:37:26.688859 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:37:26.688859 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 could not be found. Jun 29 12:37:26.688859 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:37:26.690836 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a89720dc-02b9-4ca4-b771-e2073a3a6a4a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Returning 404 to user: Instance d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:37:26.690836 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a89720dc-02b9-4ca4-b771-e2073a3a6a4a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 404 len: 111 microversion: 2.20 time: 0.036373 Jun 29 12:37:26.690836 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 263/505] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:37:26 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 12:37:26.697174 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6f9408ba-242c-4ae2-8711-f45a17630e07 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '.version_select at 0x7fdb06a1e4c0>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:26.716738 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6f9408ba-242c-4ae2-8711-f45a17630e07 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1986434234" status: 204 len: 0 microversion: 2.20 time: 0.024214 Jun 29 12:37:26.717285 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 243/506] 10.222.0.52 () {60 vars in 1261 bytes} [Wed Jun 29 12:37:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1986434234 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 29 12:37:27.387825 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4e02f3f1-4663-4f2f-91a5-8471892a010e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Action: 'create', calling method: .version_select at 0x7fdb06a31ca0>, body: {"keypair": {"name": "tempest-keypair-1995470163", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFV2ieKg01byZV1TQoy1F6BwcZqRh7/oJ4gI++bXj6KMutXSCs8dtvY2OAfQrl9P8HL1y9oSLTBHwVi29URBvVyjcNhIPS5//wCCscSMYT642O0pB5KqbzX4WH9/fHEhCg=="}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:37:27.402278 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-4e02f3f1-4663-4f2f-91a5-8471892a010e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Getting quotas for project 0ed882ae485441db99ccf6109be51b22. Resources: {'key_pairs'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:37:27.406711 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-4e02f3f1-4663-4f2f-91a5-8471892a010e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Getting quotas for user 6252d0519ed9421e89710ca5294524c5 and project 0ed882ae485441db99ccf6109be51b22. Resources: {'key_pairs'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:37:27.418190 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4e02f3f1-4663-4f2f-91a5-8471892a010e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [4898ec3e-d01f-4379-a9b3-f9d3ca94585b] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 29 12:37:28.426353 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO oslo.messaging._drivers.impl_rabbit [None req-4e02f3f1-4663-4f2f-91a5-8471892a010e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [4898ec3e-d01f-4379-a9b3-f9d3ca94585b] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 39506. Jun 29 12:37:28.440277 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4e02f3f1-4663-4f2f-91a5-8471892a010e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.056398 Jun 29 12:37:28.440907 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 264/507] 10.222.0.52 () {62 vars in 1199 bytes} [Wed Jun 29 12:37:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1058 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 29 12:37:29.777091 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-822e93bd-7723-43d5-852a-89051efd7789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-295045205", "imageRef": "70887696-f652-46b0-a5be-bfb400986078", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "397d642b-81b8-4b71-80dd-1d3a811e873b"}], "security_groups": [{"name": "tempest-securitygroup--1671174804"}], "key_name": "tempest-keypair-1995470163", "user_data": "}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:37:29.877914 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.network.neutron [None req-822e93bd-7723-43d5-852a-89051efd7789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] validate_networks() for [('397d642b-81b8-4b71-80dd-1d3a811e873b', None, None, None, None, None)] {{(pid=124316) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 12:37:30.239782 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-822e93bd-7723-43d5-852a-89051efd7789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Flavor limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 12:37:30.240206 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-822e93bd-7723-43d5-852a-89051efd7789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Image limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 12:37:30.240674 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-822e93bd-7723-43d5-852a-89051efd7789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Flavor pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 12:37:30.241080 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-822e93bd-7723-43d5-852a-89051efd7789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Image pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 12:37:30.241517 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-822e93bd-7723-43d5-852a-89051efd7789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 12:37:30.250232 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-822e93bd-7723-43d5-852a-89051efd7789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:30.250702 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-822e93bd-7723-43d5-852a-89051efd7789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:30.251485 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-822e93bd-7723-43d5-852a-89051efd7789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:30.251915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-822e93bd-7723-43d5-852a-89051efd7789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:30.268374 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-822e93bd-7723-43d5-852a-89051efd7789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Getting quotas for project 0ed882ae485441db99ccf6109be51b22. Resources: {'cores', 'ram', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:37:30.272690 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-822e93bd-7723-43d5-852a-89051efd7789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Getting quotas for user 6252d0519ed9421e89710ca5294524c5 and project 0ed882ae485441db99ccf6109be51b22. Resources: {'cores', 'ram', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:37:30.284580 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-822e93bd-7723-43d5-852a-89051efd7789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Going to run 1 instances... {{(pid=124316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 12:37:30.286937 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-822e93bd-7723-43d5-852a-89051efd7789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70887696-f652-46b0-a5be-bfb400986078',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 12:37:30.334867 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-822e93bd-7723-43d5-852a-89051efd7789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.562557 Jun 29 12:37:30.335503 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 244/508] 10.222.0.52 () {62 vars in 1187 bytes} [Wed Jun 29 12:37:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 29 12:37:30.346690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-2643aa61-d591-424e-a094-1961a2dd05a1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:30.347295 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-2643aa61-d591-424e-a094-1961a2dd05a1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:30.402890 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2643aa61-d591-424e-a094-1961a2dd05a1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:30.411587 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2643aa61-d591-424e-a094-1961a2dd05a1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:30.413083 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2643aa61-d591-424e-a094-1961a2dd05a1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:30.414226 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-2643aa61-d591-424e-a094-1961a2dd05a1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1281 microversion: 2.20 time: 0.072638 Jun 29 12:37:30.414898 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 265/509] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:37:30 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:37:31.432719 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b7fd9c7d-e51a-4664-890b-ef4a148b3fd9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:31.433331 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b7fd9c7d-e51a-4664-890b-ef4a148b3fd9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:31.440730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b7fd9c7d-e51a-4664-890b-ef4a148b3fd9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:31.441185 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b7fd9c7d-e51a-4664-890b-ef4a148b3fd9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:31.441960 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b7fd9c7d-e51a-4664-890b-ef4a148b3fd9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:31.442650 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b7fd9c7d-e51a-4664-890b-ef4a148b3fd9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:31.520039 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b7fd9c7d-e51a-4664-890b-ef4a148b3fd9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:31.529391 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b7fd9c7d-e51a-4664-890b-ef4a148b3fd9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:31.531765 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b7fd9c7d-e51a-4664-890b-ef4a148b3fd9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:31.532893 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b7fd9c7d-e51a-4664-890b-ef4a148b3fd9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1351 microversion: 2.20 time: 0.104662 Jun 29 12:37:31.533620 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 245/510] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:37:31 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:37:32.551820 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-fefd05f6-53c2-4208-a930-2a50c0ba168e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:32.552562 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-fefd05f6-53c2-4208-a930-2a50c0ba168e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:32.556013 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:37:32.559627 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fefd05f6-53c2-4208-a930-2a50c0ba168e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:32.560072 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fefd05f6-53c2-4208-a930-2a50c0ba168e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:32.560835 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fefd05f6-53c2-4208-a930-2a50c0ba168e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:32.561952 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fefd05f6-53c2-4208-a930-2a50c0ba168e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:32.703127 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-fefd05f6-53c2-4208-a930-2a50c0ba168e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:32.711064 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-fefd05f6-53c2-4208-a930-2a50c0ba168e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:32.713234 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-fefd05f6-53c2-4208-a930-2a50c0ba168e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:32.714320 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-fefd05f6-53c2-4208-a930-2a50c0ba168e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1407 microversion: 2.20 time: 0.166429 Jun 29 12:37:32.715050 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 266/511] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:37:32 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:37:33.014311 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-18beeb71-a7bc-4264-8bd4-97c40251011c req-6be50e55-db5d-4d8b-9652-428158c138ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6005eeb-de9c-4299-85da-6bf176fba2db", "tag": "91513e0c-31ea-42a7-a298-8bcc2b5e8547"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:37:33.036247 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-18beeb71-a7bc-4264-8bd4-97c40251011c req-6be50e55-db5d-4d8b-9652-428158c138ad service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:33.036783 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-18beeb71-a7bc-4264-8bd4-97c40251011c req-6be50e55-db5d-4d8b-9652-428158c138ad service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:33.050281 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-18beeb71-a7bc-4264-8bd4-97c40251011c req-6be50e55-db5d-4d8b-9652-428158c138ad service nova] Creating event network-changed:91513e0c-31ea-42a7-a298-8bcc2b5e8547 for instance b6005eeb-de9c-4299-85da-6bf176fba2db on hv-cinder-81268 Jun 29 12:37:33.056996 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-18beeb71-a7bc-4264-8bd4-97c40251011c req-6be50e55-db5d-4d8b-9652-428158c138ad service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047055 Jun 29 12:37:33.058084 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 246/512] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:37:33.732575 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d157088f-9cfd-4f15-8842-0d35ac99afd6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:33.733752 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d157088f-9cfd-4f15-8842-0d35ac99afd6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:33.739909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d157088f-9cfd-4f15-8842-0d35ac99afd6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:33.740354 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d157088f-9cfd-4f15-8842-0d35ac99afd6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:33.741103 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d157088f-9cfd-4f15-8842-0d35ac99afd6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:33.741533 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d157088f-9cfd-4f15-8842-0d35ac99afd6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:33.867781 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d157088f-9cfd-4f15-8842-0d35ac99afd6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:33.877016 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d157088f-9cfd-4f15-8842-0d35ac99afd6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:33.878571 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d157088f-9cfd-4f15-8842-0d35ac99afd6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:33.879661 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d157088f-9cfd-4f15-8842-0d35ac99afd6 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1407 microversion: 2.20 time: 0.151124 Jun 29 12:37:33.880213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 267/513] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:37:33 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:37:34.520506 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a7a8118b-2d8f-4dc8-b6a5-c1fa3364e0e9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:34.521518 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a7a8118b-2d8f-4dc8-b6a5-c1fa3364e0e9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:34.527784 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a7a8118b-2d8f-4dc8-b6a5-c1fa3364e0e9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:34.528233 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a7a8118b-2d8f-4dc8-b6a5-c1fa3364e0e9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:34.528988 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a7a8118b-2d8f-4dc8-b6a5-c1fa3364e0e9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:34.529419 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a7a8118b-2d8f-4dc8-b6a5-c1fa3364e0e9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:34.560377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a7a8118b-2d8f-4dc8-b6a5-c1fa3364e0e9 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046036 Jun 29 12:37:34.560941 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 247/514] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 12:37:34 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 12:37:34.619830 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c691336f-4757-4d69-88d7-5df6b37ac2aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:34.620248 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c691336f-4757-4d69-88d7-5df6b37ac2aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:34.626869 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c691336f-4757-4d69-88d7-5df6b37ac2aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:34.627320 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c691336f-4757-4d69-88d7-5df6b37ac2aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:34.628099 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c691336f-4757-4d69-88d7-5df6b37ac2aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:34.628570 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c691336f-4757-4d69-88d7-5df6b37ac2aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:34.653568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c691336f-4757-4d69-88d7-5df6b37ac2aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Going to try to terminate instance {{(pid=124317) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 12:37:34.731657 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c691336f-4757-4d69-88d7-5df6b37ac2aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "DELETE /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 204 len: 0 microversion: 2.1 time: 0.115481 Jun 29 12:37:34.732598 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 268/515] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:37:34 2022] DELETE /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 29 12:37:34.741843 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-00f43d16-9e4b-4eea-89eb-c47bdf9e6941 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:34.742486 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-00f43d16-9e4b-4eea-89eb-c47bdf9e6941 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:34.749299 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-00f43d16-9e4b-4eea-89eb-c47bdf9e6941 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:34.749868 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-00f43d16-9e4b-4eea-89eb-c47bdf9e6941 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:34.751024 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-00f43d16-9e4b-4eea-89eb-c47bdf9e6941 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:34.751459 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-00f43d16-9e4b-4eea-89eb-c47bdf9e6941 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:34.897193 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1172f4e9-0e27-4c27-8c1d-1327faf3ae1a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:34.897974 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1172f4e9-0e27-4c27-8c1d-1327faf3ae1a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:34.904478 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1172f4e9-0e27-4c27-8c1d-1327faf3ae1a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:34.904943 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1172f4e9-0e27-4c27-8c1d-1327faf3ae1a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:34.905693 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1172f4e9-0e27-4c27-8c1d-1327faf3ae1a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:34.906122 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1172f4e9-0e27-4c27-8c1d-1327faf3ae1a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:34.924350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:37:34.933576 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-00f43d16-9e4b-4eea-89eb-c47bdf9e6941 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:34.941870 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-00f43d16-9e4b-4eea-89eb-c47bdf9e6941 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1675 microversion: 2.1 time: 0.204198 Jun 29 12:37:34.942601 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 248/516] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:34 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1675 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:35.042534 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1172f4e9-0e27-4c27-8c1d-1327faf3ae1a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:35.050955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1172f4e9-0e27-4c27-8c1d-1327faf3ae1a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:35.052456 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1172f4e9-0e27-4c27-8c1d-1327faf3ae1a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:35.053557 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1172f4e9-0e27-4c27-8c1d-1327faf3ae1a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1407 microversion: 2.20 time: 0.160906 Jun 29 12:37:35.054108 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 269/517] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:37:34 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:37:35.959971 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6249ef34-194c-4b07-8eff-45e8822fb308 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:35.960501 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6249ef34-194c-4b07-8eff-45e8822fb308 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:35.968329 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6249ef34-194c-4b07-8eff-45e8822fb308 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:35.968779 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6249ef34-194c-4b07-8eff-45e8822fb308 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:35.969536 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6249ef34-194c-4b07-8eff-45e8822fb308 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:35.969970 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6249ef34-194c-4b07-8eff-45e8822fb308 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:36.071976 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f9b811c3-bbf9-4ddb-8707-6eab831d10eb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:36.072587 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f9b811c3-bbf9-4ddb-8707-6eab831d10eb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:36.079538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f9b811c3-bbf9-4ddb-8707-6eab831d10eb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:36.079986 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f9b811c3-bbf9-4ddb-8707-6eab831d10eb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:36.080764 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f9b811c3-bbf9-4ddb-8707-6eab831d10eb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:36.081190 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f9b811c3-bbf9-4ddb-8707-6eab831d10eb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:36.102644 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6249ef34-194c-4b07-8eff-45e8822fb308 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:36.110828 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6249ef34-194c-4b07-8eff-45e8822fb308 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1675 microversion: 2.1 time: 0.154733 Jun 29 12:37:36.111401 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 249/518] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:35 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:36.216342 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f9b811c3-bbf9-4ddb-8707-6eab831d10eb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:36.224705 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f9b811c3-bbf9-4ddb-8707-6eab831d10eb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:36.226227 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f9b811c3-bbf9-4ddb-8707-6eab831d10eb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:36.227352 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f9b811c3-bbf9-4ddb-8707-6eab831d10eb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1407 microversion: 2.20 time: 0.159896 Jun 29 12:37:36.227911 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 270/519] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:37:36 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:37:37.128371 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8683924b-ebbf-49e2-9eaa-ac649054beb8 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:37.129007 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8683924b-ebbf-49e2-9eaa-ac649054beb8 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:37.135390 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8683924b-ebbf-49e2-9eaa-ac649054beb8 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:37.135841 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8683924b-ebbf-49e2-9eaa-ac649054beb8 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:37.136634 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8683924b-ebbf-49e2-9eaa-ac649054beb8 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:37.137070 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8683924b-ebbf-49e2-9eaa-ac649054beb8 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:37.139937 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:37:37.245703 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0492e8bc-01d4-4142-b0d2-70d7c927770c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:37.246303 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0492e8bc-01d4-4142-b0d2-70d7c927770c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:37.253574 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0492e8bc-01d4-4142-b0d2-70d7c927770c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:37.254020 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0492e8bc-01d4-4142-b0d2-70d7c927770c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:37.254818 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0492e8bc-01d4-4142-b0d2-70d7c927770c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:37.255251 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0492e8bc-01d4-4142-b0d2-70d7c927770c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:37.381985 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8683924b-ebbf-49e2-9eaa-ac649054beb8 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:37.390368 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0492e8bc-01d4-4142-b0d2-70d7c927770c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:37.391248 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8683924b-ebbf-49e2-9eaa-ac649054beb8 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 200 len: 1675 microversion: 2.1 time: 0.267351 Jun 29 12:37:37.392206 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 250/520] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:37 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 1675 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:37.399475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0492e8bc-01d4-4142-b0d2-70d7c927770c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:37.401161 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0492e8bc-01d4-4142-b0d2-70d7c927770c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:37.402310 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0492e8bc-01d4-4142-b0d2-70d7c927770c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1407 microversion: 2.20 time: 0.160754 Jun 29 12:37:37.403186 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 271/521] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:37:37 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:37:37.587617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-ec50a9a6-bbc0-47a3-9f13-e37aa355291d req-6cc0b866-b544-499d-8e43-0e78169195b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "850c462a-25ae-40e2-a43b-fdf1ec4ab8e4", "name": "network-vif-deleted", "tag": "10f89cd0-bfe6-4930-8b3e-f58f898ca571"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:37:37.597959 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-ec50a9a6-bbc0-47a3-9f13-e37aa355291d req-6cc0b866-b544-499d-8e43-0e78169195b0 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:37.598999 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-ec50a9a6-bbc0-47a3-9f13-e37aa355291d req-6cc0b866-b544-499d-8e43-0e78169195b0 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:37.614208 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-ec50a9a6-bbc0-47a3-9f13-e37aa355291d req-6cc0b866-b544-499d-8e43-0e78169195b0 service nova] Creating event network-vif-deleted:10f89cd0-bfe6-4930-8b3e-f58f898ca571 for instance 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 on hv-cinder-81268 Jun 29 12:37:37.624547 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-ec50a9a6-bbc0-47a3-9f13-e37aa355291d req-6cc0b866-b544-499d-8e43-0e78169195b0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041711 Jun 29 12:37:37.637552 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 251/522] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:37:37.722051 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-bababdee-8efd-42c9-9b6b-90ec2a52257c req-946666d1-b51d-48ed-92ae-82424e14f104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6005eeb-de9c-4299-85da-6bf176fba2db", "name": "network-vif-plugged", "status": "completed", "tag": "91513e0c-31ea-42a7-a298-8bcc2b5e8547"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:37:37.737350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-bababdee-8efd-42c9-9b6b-90ec2a52257c req-946666d1-b51d-48ed-92ae-82424e14f104 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:37.737739 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-bababdee-8efd-42c9-9b6b-90ec2a52257c req-946666d1-b51d-48ed-92ae-82424e14f104 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:37.759153 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-bababdee-8efd-42c9-9b6b-90ec2a52257c req-946666d1-b51d-48ed-92ae-82424e14f104 service nova] Creating event network-vif-plugged:91513e0c-31ea-42a7-a298-8bcc2b5e8547 for instance b6005eeb-de9c-4299-85da-6bf176fba2db on hv-cinder-81268 Jun 29 12:37:37.765130 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-bababdee-8efd-42c9-9b6b-90ec2a52257c req-946666d1-b51d-48ed-92ae-82424e14f104 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048248 Jun 29 12:37:37.766491 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 272/523] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:37:38.409926 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-426b51ea-4abf-4cc4-a4c5-300cd45126fb tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:38.410663 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-426b51ea-4abf-4cc4-a4c5-300cd45126fb tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:38.417343 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-426b51ea-4abf-4cc4-a4c5-300cd45126fb tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:38.417725 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-426b51ea-4abf-4cc4-a4c5-300cd45126fb tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:38.418725 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-426b51ea-4abf-4cc4-a4c5-300cd45126fb tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:38.419167 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-426b51ea-4abf-4cc4-a4c5-300cd45126fb tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:38.421546 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0a6eb520-e3ea-47ff-ac23-7edb795f2ffc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:38.422509 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0a6eb520-e3ea-47ff-ac23-7edb795f2ffc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:38.430597 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0a6eb520-e3ea-47ff-ac23-7edb795f2ffc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:38.431053 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0a6eb520-e3ea-47ff-ac23-7edb795f2ffc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:38.431837 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0a6eb520-e3ea-47ff-ac23-7edb795f2ffc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:38.432279 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0a6eb520-e3ea-47ff-ac23-7edb795f2ffc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:38.433818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-426b51ea-4abf-4cc4-a4c5-300cd45126fb tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] HTTP exception thrown: Instance 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 could not be found. Jun 29 12:37:38.435554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-426b51ea-4abf-4cc4-a4c5-300cd45126fb tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Request method failure captured: Jun 29 12:37:38.435554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 HTTP/1.1 Jun 29 12:37:38.435554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept: application/json Jun 29 12:37:38.435554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jun 29 12:37:38.435554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Connection: close Jun 29 12:37:38.435554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jun 29 12:37:38.435554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jun 29 12:37:38.435554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Host: 10.222.0.52 Jun 29 12:37:38.435554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jun 29 12:37:38.435554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jun 29 12:37:38.435554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivEabXIL6gg7MaO_iQcLyCSpOj-yYEQAE4-EwC2BHNjvXJgBXSyHZiJrkZkCL_QYzSEa5dmCobD4FC0NoEGOHP4QYIHYmZJFnNyp4C6hmRKmQTZVCx6Vti0vfYlx_hga1ycdQs9EhKduLp5TX2R2LyzJgxQ2nPNw9OZJzW84KEA9YjSs Jun 29 12:37:38.435554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jun 29 12:37:38.435554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jun 29 12:37:38.435554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jun 29 12:37:38.435554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jun 29 12:37:38.435554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jun 29 12:37:38.435554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jun 29 12:37:38.435554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Id: 0f625199b4eb48c98944ea79a90f2841 Jun 29 12:37:38.435554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-AttachVolumeTestJSON-322810237 Jun 29 12:37:38.435554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jun 29 12:37:38.435554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jun 29 12:37:38.437078 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0f625199b4eb48c98944ea79a90f2841", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0f625199b4eb48c98944ea79a90f2841"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0f625199b4eb48c98944ea79a90f2841"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0f625199b4eb48c98944ea79a90f2841"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:37:38.437078 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-AttachVolumeTestJSON-322810237 Jun 29 12:37:38.437078 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Id: 0f625199b4eb48c98944ea79a90f2841 Jun 29 12:37:38.437078 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-AttachVolumeTestJSON-322810237 Jun 29 12:37:38.437078 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User: tempest-AttachVolumeTestJSON-322810237-project Jun 29 12:37:38.437078 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jun 29 12:37:38.437078 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jun 29 12:37:38.437078 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Id: a4a30b65a91a4fd89e8b59df670f60ad Jun 29 12:37:38.437078 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-AttachVolumeTestJSON-322810237-project Jun 29 12:37:38.437078 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: method: > Jun 29 12:37:38.437078 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: exception: Instance 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 could not be found. Jun 29 12:37:38.437078 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: action_args: {'id': '850c462a-25ae-40e2-a43b-fdf1ec4ab8e4'} Jun 29 12:37:38.437805 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:37:38.437805 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:37:38.437805 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:37:38.437805 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:37:38.437805 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:37:38.437805 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:37:38.437805 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:37:38.437805 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:37:38.437805 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:37:38.437805 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:37:38.437805 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 could not be found. Jun 29 12:37:38.437805 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:37:38.437805 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:37:38.437805 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:37:38.437805 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:37:38.437805 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:37:38.437805 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:37:38.437805 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:37:38.437805 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:37:38.437805 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:37:38.439021 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:37:38.439021 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:37:38.439021 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:37:38.439021 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:37:38.439021 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:37:38.439021 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:37:38.439021 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:37:38.439021 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 could not be found. Jun 29 12:37:38.439021 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:37:38.439021 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:37:38.439021 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:37:38.439021 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:37:38.439021 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:37:38.439021 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:37:38.439021 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:37:38.439021 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:37:38.439021 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 could not be found. Jun 29 12:37:38.439021 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:37:38.440073 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-426b51ea-4abf-4cc4-a4c5-300cd45126fb tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Returning 404 to user: Instance 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:37:38.440073 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-426b51ea-4abf-4cc4-a4c5-300cd45126fb tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 404 len: 111 microversion: 2.1 time: 0.033043 Jun 29 12:37:38.440073 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 252/524] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:38 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:37:38.446861 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d9224da0-a2cc-4264-9bc4-c8608cc6b853 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '.version_select at 0x7fdb069fc310>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:38.465344 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d9224da0-a2cc-4264-9bc4-c8608cc6b853 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1121858358" status: 202 len: 0 microversion: 2.1 time: 0.022140 Jun 29 12:37:38.470604 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 253/525] 10.222.0.52 () {58 vars in 1220 bytes} [Wed Jun 29 12:37:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1121858358 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:37:38.600582 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0a6eb520-e3ea-47ff-ac23-7edb795f2ffc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:38.610260 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0a6eb520-e3ea-47ff-ac23-7edb795f2ffc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:38.611819 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0a6eb520-e3ea-47ff-ac23-7edb795f2ffc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:38.612946 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0a6eb520-e3ea-47ff-ac23-7edb795f2ffc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1407 microversion: 2.20 time: 0.195731 Jun 29 12:37:38.613498 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 273/526] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:37:38 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:37:39.094101 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9fe7e2b0-f923-4def-9fec-0a402bf54de3 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Action: 'create', calling method: .version_select at 0x7fdb06aa0e50>, body: {"keypair": {"name": "tempest-keypair-1813030455", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHQDulZu18ISiY2Ww+LdOFso7VYewsEoJOutf70YF6PRbLfZZyGKdG5fsBhuucarqO1MtSfsO+ND0o/n5lGQ50aRRW2ejyAj5QU95CFG1C9/gtUgdS9VBO03eP9QdRvMw=="}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:37:39.109168 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-9fe7e2b0-f923-4def-9fec-0a402bf54de3 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Getting quotas for project 0f625199b4eb48c98944ea79a90f2841. Resources: {'key_pairs'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:37:39.112984 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-9fe7e2b0-f923-4def-9fec-0a402bf54de3 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Getting quotas for user a4a30b65a91a4fd89e8b59df670f60ad and project 0f625199b4eb48c98944ea79a90f2841. Resources: {'key_pairs'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:37:39.133882 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9fe7e2b0-f923-4def-9fec-0a402bf54de3 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044289 Jun 29 12:37:39.134471 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 254/527] 10.222.0.52 () {60 vars in 1158 bytes} [Wed Jun 29 12:37:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:37:39.631011 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b9b23e9a-c4ca-4855-a061-499892df473d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:39.631617 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b9b23e9a-c4ca-4855-a061-499892df473d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:39.637476 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b9b23e9a-c4ca-4855-a061-499892df473d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:39.637918 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b9b23e9a-c4ca-4855-a061-499892df473d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:39.638694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b9b23e9a-c4ca-4855-a061-499892df473d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:39.639164 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b9b23e9a-c4ca-4855-a061-499892df473d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:39.799140 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b9b23e9a-c4ca-4855-a061-499892df473d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:39.807002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b9b23e9a-c4ca-4855-a061-499892df473d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:39.808488 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b9b23e9a-c4ca-4855-a061-499892df473d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:39.809574 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b9b23e9a-c4ca-4855-a061-499892df473d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1407 microversion: 2.20 time: 0.182451 Jun 29 12:37:39.810167 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 274/528] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:37:39 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:37:40.407032 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:37:40.411509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f43ff2d5-1f63-4365-8c2f-298e37ba3179 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2004018240", "imageRef": "70887696-f652-46b0-a5be-bfb400986078", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b5a74d9-0a05-4165-ad79-54d13b50c375"}], "security_groups": [{"name": "tempest-securitygroup--1528759281"}], "key_name": "tempest-keypair-1813030455", "user_data": "}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:37:40.511874 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.network.neutron [None req-f43ff2d5-1f63-4365-8c2f-298e37ba3179 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] validate_networks() for [('7b5a74d9-0a05-4165-ad79-54d13b50c375', None, None, None, None, None)] {{(pid=124316) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 12:37:40.828398 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b06f3f3a-94d2-4d7a-b919-6f970d85c0ea tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:40.829005 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b06f3f3a-94d2-4d7a-b919-6f970d85c0ea tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:40.830997 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=6 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:37:40.836393 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b06f3f3a-94d2-4d7a-b919-6f970d85c0ea tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:40.836844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b06f3f3a-94d2-4d7a-b919-6f970d85c0ea tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:40.837606 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b06f3f3a-94d2-4d7a-b919-6f970d85c0ea tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:40.838041 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b06f3f3a-94d2-4d7a-b919-6f970d85c0ea tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:40.977340 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b06f3f3a-94d2-4d7a-b919-6f970d85c0ea tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:40.986272 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b06f3f3a-94d2-4d7a-b919-6f970d85c0ea tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:40.987924 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b06f3f3a-94d2-4d7a-b919-6f970d85c0ea tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:40.989076 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b06f3f3a-94d2-4d7a-b919-6f970d85c0ea tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1598 microversion: 2.20 time: 0.165455 Jun 29 12:37:40.989631 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 275/529] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:37:40 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:37:41.007493 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5d11b78e-213c-4054-a095-1695ba4dd94d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:41.008168 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5d11b78e-213c-4054-a095-1695ba4dd94d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:41.014866 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5d11b78e-213c-4054-a095-1695ba4dd94d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:41.015522 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5d11b78e-213c-4054-a095-1695ba4dd94d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:41.016370 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5d11b78e-213c-4054-a095-1695ba4dd94d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:41.016867 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5d11b78e-213c-4054-a095-1695ba4dd94d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:41.096518 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5d11b78e-213c-4054-a095-1695ba4dd94d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092942 Jun 29 12:37:41.097247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 276/530] 10.222.0.52 () {60 vars in 1315 bytes} [Wed Jun 29 12:37:41 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 12:37:41.123274 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-f43ff2d5-1f63-4365-8c2f-298e37ba3179 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Flavor limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 12:37:41.123737 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-f43ff2d5-1f63-4365-8c2f-298e37ba3179 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Image limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 12:37:41.124219 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-f43ff2d5-1f63-4365-8c2f-298e37ba3179 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Flavor pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 12:37:41.124634 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-f43ff2d5-1f63-4365-8c2f-298e37ba3179 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Image pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 12:37:41.125047 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-f43ff2d5-1f63-4365-8c2f-298e37ba3179 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 12:37:41.133991 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f43ff2d5-1f63-4365-8c2f-298e37ba3179 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:41.134383 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f43ff2d5-1f63-4365-8c2f-298e37ba3179 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:41.135217 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f43ff2d5-1f63-4365-8c2f-298e37ba3179 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:41.135660 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f43ff2d5-1f63-4365-8c2f-298e37ba3179 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:41.153218 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-f43ff2d5-1f63-4365-8c2f-298e37ba3179 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Getting quotas for project 0f625199b4eb48c98944ea79a90f2841. Resources: {'cores', 'ram', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:37:41.158376 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-f43ff2d5-1f63-4365-8c2f-298e37ba3179 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Getting quotas for user a4a30b65a91a4fd89e8b59df670f60ad and project 0f625199b4eb48c98944ea79a90f2841. Resources: {'cores', 'ram', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:37:41.169406 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f43ff2d5-1f63-4365-8c2f-298e37ba3179 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Going to run 1 instances... {{(pid=124316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 12:37:41.172487 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f43ff2d5-1f63-4365-8c2f-298e37ba3179 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70887696-f652-46b0-a5be-bfb400986078',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 12:37:41.219604 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f43ff2d5-1f63-4365-8c2f-298e37ba3179 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.814520 Jun 29 12:37:41.221164 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 255/531] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 12:37:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 12:37:41.230197 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0e56fa40-a3c7-4315-acde-f7aedefcd87f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:41.230937 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0e56fa40-a3c7-4315-acde-f7aedefcd87f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:41.297330 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0e56fa40-a3c7-4315-acde-f7aedefcd87f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:41.307242 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0e56fa40-a3c7-4315-acde-f7aedefcd87f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece" status: 200 len: 1238 microversion: 2.1 time: 0.080819 Jun 29 12:37:41.307842 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 277/532] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:41 2022] GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece => generated 1238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:37:42.327687 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-aa5a64d5-813f-4b75-b8b8-ce83cc484daf req-8f332b6d-db8c-48c9-83ea-ca9aaf4ea593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6005eeb-de9c-4299-85da-6bf176fba2db", "tag": "91513e0c-31ea-42a7-a298-8bcc2b5e8547"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:37:42.328477 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2605908f-7297-43e2-afd9-3bbaa7a4d2f0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:42.329100 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2605908f-7297-43e2-afd9-3bbaa7a4d2f0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:42.340381 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-aa5a64d5-813f-4b75-b8b8-ce83cc484daf req-8f332b6d-db8c-48c9-83ea-ca9aaf4ea593 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:42.340634 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2605908f-7297-43e2-afd9-3bbaa7a4d2f0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:42.340866 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2605908f-7297-43e2-afd9-3bbaa7a4d2f0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:42.343435 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2605908f-7297-43e2-afd9-3bbaa7a4d2f0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:42.343885 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2605908f-7297-43e2-afd9-3bbaa7a4d2f0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:42.344190 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-aa5a64d5-813f-4b75-b8b8-ce83cc484daf req-8f332b6d-db8c-48c9-83ea-ca9aaf4ea593 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:42.380630 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-aa5a64d5-813f-4b75-b8b8-ce83cc484daf req-8f332b6d-db8c-48c9-83ea-ca9aaf4ea593 service nova] Creating event network-changed:91513e0c-31ea-42a7-a298-8bcc2b5e8547 for instance b6005eeb-de9c-4299-85da-6bf176fba2db on hv-cinder-81268 Jun 29 12:37:42.386285 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-aa5a64d5-813f-4b75-b8b8-ce83cc484daf req-8f332b6d-db8c-48c9-83ea-ca9aaf4ea593 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062618 Jun 29 12:37:42.391745 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 278/533] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:37:42.431496 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2605908f-7297-43e2-afd9-3bbaa7a4d2f0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:42.440196 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2605908f-7297-43e2-afd9-3bbaa7a4d2f0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece" status: 200 len: 1296 microversion: 2.1 time: 0.119616 Jun 29 12:37:42.440951 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 256/534] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:42 2022] GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece => generated 1296 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:43.460826 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-35dd5e93-c6f5-4da1-bc7d-80848ddeeef0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:43.461526 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-35dd5e93-c6f5-4da1-bc7d-80848ddeeef0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:43.468203 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-35dd5e93-c6f5-4da1-bc7d-80848ddeeef0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:43.468655 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-35dd5e93-c6f5-4da1-bc7d-80848ddeeef0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:43.469644 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-35dd5e93-c6f5-4da1-bc7d-80848ddeeef0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:43.470086 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-35dd5e93-c6f5-4da1-bc7d-80848ddeeef0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:43.615654 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-35dd5e93-c6f5-4da1-bc7d-80848ddeeef0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:43.623401 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-35dd5e93-c6f5-4da1-bc7d-80848ddeeef0 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece" status: 200 len: 1364 microversion: 2.1 time: 0.167575 Jun 29 12:37:43.624672 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 279/535] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:43 2022] GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:44.034658 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-c5fb5378-6356-4810-810e-cf88af277d23 req-219bbf49-c4dc-4ce8-be54-b34af6af330e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32214b00-153f-4be8-a43b-7babcb3c0ece", "tag": "8007b1cc-4e70-43ea-add8-ccc1e13e5610"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:37:44.047218 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-c5fb5378-6356-4810-810e-cf88af277d23 req-219bbf49-c4dc-4ce8-be54-b34af6af330e service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:44.057192 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-c5fb5378-6356-4810-810e-cf88af277d23 req-219bbf49-c4dc-4ce8-be54-b34af6af330e service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:44.069693 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-c5fb5378-6356-4810-810e-cf88af277d23 req-219bbf49-c4dc-4ce8-be54-b34af6af330e service nova] Creating event network-changed:8007b1cc-4e70-43ea-add8-ccc1e13e5610 for instance 32214b00-153f-4be8-a43b-7babcb3c0ece on hv-cinder-81268 Jun 29 12:37:44.074461 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-c5fb5378-6356-4810-810e-cf88af277d23 req-219bbf49-c4dc-4ce8-be54-b34af6af330e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045243 Jun 29 12:37:44.075245 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 257/536] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:37:44.641634 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0970b974-3bbc-4ebf-baab-c83760430496 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:44.642239 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0970b974-3bbc-4ebf-baab-c83760430496 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:44.648673 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0970b974-3bbc-4ebf-baab-c83760430496 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:44.649117 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0970b974-3bbc-4ebf-baab-c83760430496 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:44.649870 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0970b974-3bbc-4ebf-baab-c83760430496 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:44.650297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0970b974-3bbc-4ebf-baab-c83760430496 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:44.787275 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0970b974-3bbc-4ebf-baab-c83760430496 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:44.794598 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0970b974-3bbc-4ebf-baab-c83760430496 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece" status: 200 len: 1364 microversion: 2.1 time: 0.157722 Jun 29 12:37:44.795208 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 280/537] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:44 2022] GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:45.811918 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5eab915c-cea1-4416-aa7f-9111ae1207cc tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:45.812761 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5eab915c-cea1-4416-aa7f-9111ae1207cc tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:45.818949 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5eab915c-cea1-4416-aa7f-9111ae1207cc tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:45.819406 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5eab915c-cea1-4416-aa7f-9111ae1207cc tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:45.820190 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5eab915c-cea1-4416-aa7f-9111ae1207cc tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:45.820624 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5eab915c-cea1-4416-aa7f-9111ae1207cc tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:45.946721 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5eab915c-cea1-4416-aa7f-9111ae1207cc tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:45.954554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5eab915c-cea1-4416-aa7f-9111ae1207cc tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece" status: 200 len: 1364 microversion: 2.1 time: 0.147407 Jun 29 12:37:45.955116 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 258/538] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:45 2022] GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:46.972061 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-bfe73af1-f726-4bb0-a46d-23b465e0af9f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:46.972593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-bfe73af1-f726-4bb0-a46d-23b465e0af9f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:46.979085 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bfe73af1-f726-4bb0-a46d-23b465e0af9f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:46.979527 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bfe73af1-f726-4bb0-a46d-23b465e0af9f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:46.980272 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bfe73af1-f726-4bb0-a46d-23b465e0af9f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:46.980703 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bfe73af1-f726-4bb0-a46d-23b465e0af9f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:47.108184 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-bfe73af1-f726-4bb0-a46d-23b465e0af9f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:47.115784 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-bfe73af1-f726-4bb0-a46d-23b465e0af9f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece" status: 200 len: 1364 microversion: 2.1 time: 0.147550 Jun 29 12:37:47.116341 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 281/539] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:46 2022] GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:48.132934 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-20af42fc-9abe-4575-9135-16d1e894d6b4 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:48.133594 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-20af42fc-9abe-4575-9135-16d1e894d6b4 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:48.136040 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=7 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:37:48.142391 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-20af42fc-9abe-4575-9135-16d1e894d6b4 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:48.142870 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-20af42fc-9abe-4575-9135-16d1e894d6b4 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:48.143643 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-20af42fc-9abe-4575-9135-16d1e894d6b4 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:48.144079 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-20af42fc-9abe-4575-9135-16d1e894d6b4 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:48.276092 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-20af42fc-9abe-4575-9135-16d1e894d6b4 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:48.284382 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-20af42fc-9abe-4575-9135-16d1e894d6b4 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece" status: 200 len: 1364 microversion: 2.1 time: 0.155312 Jun 29 12:37:48.284943 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 259/540] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:48 2022] GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:37:49.300726 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-651edcf2-fb7d-451c-a34c-afcd73c4b672 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:49.301373 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-651edcf2-fb7d-451c-a34c-afcd73c4b672 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:49.307643 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-651edcf2-fb7d-451c-a34c-afcd73c4b672 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:49.308083 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-651edcf2-fb7d-451c-a34c-afcd73c4b672 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:49.308834 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-651edcf2-fb7d-451c-a34c-afcd73c4b672 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:49.309266 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-651edcf2-fb7d-451c-a34c-afcd73c4b672 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:49.442063 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-651edcf2-fb7d-451c-a34c-afcd73c4b672 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:49.449383 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-651edcf2-fb7d-451c-a34c-afcd73c4b672 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece" status: 200 len: 1364 microversion: 2.1 time: 0.152481 Jun 29 12:37:49.449939 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 282/541] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:49 2022] GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:49.735552 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-b9fe3424-d7df-4ff3-9651-8e9c21948952 req-87f0f4fd-2adf-4d6b-94ae-cfdb87ac8ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32214b00-153f-4be8-a43b-7babcb3c0ece", "name": "network-vif-plugged", "status": "completed", "tag": "8007b1cc-4e70-43ea-add8-ccc1e13e5610"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:37:49.743574 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-b9fe3424-d7df-4ff3-9651-8e9c21948952 req-87f0f4fd-2adf-4d6b-94ae-cfdb87ac8ae4 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:49.744015 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-b9fe3424-d7df-4ff3-9651-8e9c21948952 req-87f0f4fd-2adf-4d6b-94ae-cfdb87ac8ae4 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:49.757259 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-b9fe3424-d7df-4ff3-9651-8e9c21948952 req-87f0f4fd-2adf-4d6b-94ae-cfdb87ac8ae4 service nova] Creating event network-vif-plugged:8007b1cc-4e70-43ea-add8-ccc1e13e5610 for instance 32214b00-153f-4be8-a43b-7babcb3c0ece on hv-cinder-81268 Jun 29 12:37:49.761912 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-b9fe3424-d7df-4ff3-9651-8e9c21948952 req-87f0f4fd-2adf-4d6b-94ae-cfdb87ac8ae4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030810 Jun 29 12:37:49.762501 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 260/542] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:37:50.466675 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-05b8a28a-bd45-4bab-b4fa-15bda50c91ed tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:50.467946 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-05b8a28a-bd45-4bab-b4fa-15bda50c91ed tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:50.473897 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-05b8a28a-bd45-4bab-b4fa-15bda50c91ed tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:50.474337 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-05b8a28a-bd45-4bab-b4fa-15bda50c91ed tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:50.475117 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-05b8a28a-bd45-4bab-b4fa-15bda50c91ed tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:50.475551 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-05b8a28a-bd45-4bab-b4fa-15bda50c91ed tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:50.605398 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-05b8a28a-bd45-4bab-b4fa-15bda50c91ed tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:50.612941 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-05b8a28a-bd45-4bab-b4fa-15bda50c91ed tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece" status: 200 len: 1364 microversion: 2.1 time: 0.150159 Jun 29 12:37:50.613496 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 283/543] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:50 2022] GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:51.104597 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-aec929d5-0fd7-4058-9039-0e015449ea51 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:51.105177 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-aec929d5-0fd7-4058-9039-0e015449ea51 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:51.111952 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-aec929d5-0fd7-4058-9039-0e015449ea51 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:51.112405 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-aec929d5-0fd7-4058-9039-0e015449ea51 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:51.113159 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-aec929d5-0fd7-4058-9039-0e015449ea51 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:51.113594 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-aec929d5-0fd7-4058-9039-0e015449ea51 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:51.143912 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:37:51.165303 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=16 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:37:51.235800 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-aec929d5-0fd7-4058-9039-0e015449ea51 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lazy-loading 'services' on Instance uuid 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 12:37:51.348869 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-aec929d5-0fd7-4058-9039-0e015449ea51 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "DELETE /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c/os-volume_attachments/57c9cd4f-d05a-4d10-904d-34d8ffde5aa7" status: 202 len: 0 microversion: 2.1 time: 0.248847 Jun 29 12:37:51.349487 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 261/544] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 12:37:51 2022] DELETE /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c/os-volume_attachments/57c9cd4f-d05a-4d10-904d-34d8ffde5aa7 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:37:51.358856 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b87e72d9-f8d5-47b9-ba0e-74c343ebf52f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:51.359785 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b87e72d9-f8d5-47b9-ba0e-74c343ebf52f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:51.361829 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:37:51.367676 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b87e72d9-f8d5-47b9-ba0e-74c343ebf52f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:51.368128 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b87e72d9-f8d5-47b9-ba0e-74c343ebf52f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:51.368924 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b87e72d9-f8d5-47b9-ba0e-74c343ebf52f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:51.369386 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b87e72d9-f8d5-47b9-ba0e-74c343ebf52f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:51.399196 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b87e72d9-f8d5-47b9-ba0e-74c343ebf52f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045348 Jun 29 12:37:51.399788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 284/545] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 12:37:51 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:37:51.632609 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-535c0c56-9d88-4dbd-a970-a1226bf59cdd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:51.633629 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-535c0c56-9d88-4dbd-a970-a1226bf59cdd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:51.640463 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-535c0c56-9d88-4dbd-a970-a1226bf59cdd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:51.641543 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-535c0c56-9d88-4dbd-a970-a1226bf59cdd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:51.642850 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-535c0c56-9d88-4dbd-a970-a1226bf59cdd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:51.643452 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-535c0c56-9d88-4dbd-a970-a1226bf59cdd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:51.775680 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-535c0c56-9d88-4dbd-a970-a1226bf59cdd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:51.784349 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-535c0c56-9d88-4dbd-a970-a1226bf59cdd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece" status: 200 len: 1551 microversion: 2.1 time: 0.157527 Jun 29 12:37:51.784906 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 262/546] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:51 2022] GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece => generated 1551 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:51.800880 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a2d52d92-3dbc-4821-b0fd-cc0946665510 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:51.801464 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a2d52d92-3dbc-4821-b0fd-cc0946665510 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:51.807618 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a2d52d92-3dbc-4821-b0fd-cc0946665510 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:51.808064 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a2d52d92-3dbc-4821-b0fd-cc0946665510 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:51.808843 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a2d52d92-3dbc-4821-b0fd-cc0946665510 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:51.809276 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a2d52d92-3dbc-4821-b0fd-cc0946665510 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:51.883824 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a2d52d92-3dbc-4821-b0fd-cc0946665510 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086692 Jun 29 12:37:51.884418 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 285/547] 10.222.0.52 () {58 vars in 1274 bytes} [Wed Jun 29 12:37:51 2022] GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:37:52.411470 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a771692c-8c89-4ec8-92f6-cf12624da3f7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:52.412398 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a771692c-8c89-4ec8-92f6-cf12624da3f7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:52.419040 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a771692c-8c89-4ec8-92f6-cf12624da3f7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:52.419493 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a771692c-8c89-4ec8-92f6-cf12624da3f7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:52.420466 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a771692c-8c89-4ec8-92f6-cf12624da3f7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:52.420907 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a771692c-8c89-4ec8-92f6-cf12624da3f7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:52.450349 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a771692c-8c89-4ec8-92f6-cf12624da3f7 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042798 Jun 29 12:37:52.451047 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 263/548] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 12:37:52 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 29 12:37:52.520955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e5f9836b-bd50-400c-979c-6c8920dd1702 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:52.521447 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e5f9836b-bd50-400c-979c-6c8920dd1702 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:52.527539 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e5f9836b-bd50-400c-979c-6c8920dd1702 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:52.528013 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e5f9836b-bd50-400c-979c-6c8920dd1702 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:52.528767 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e5f9836b-bd50-400c-979c-6c8920dd1702 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:52.529231 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e5f9836b-bd50-400c-979c-6c8920dd1702 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:52.553404 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e5f9836b-bd50-400c-979c-6c8920dd1702 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Going to try to terminate instance {{(pid=124317) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 12:37:52.630276 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e5f9836b-bd50-400c-979c-6c8920dd1702 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "DELETE /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 204 len: 0 microversion: 2.1 time: 0.113816 Jun 29 12:37:52.631258 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 286/549] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:37:52 2022] DELETE /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 29 12:37:52.639326 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fe1c9741-58c2-4b64-a088-d1272780099a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:52.639866 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-fe1c9741-58c2-4b64-a088-d1272780099a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:52.646046 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fe1c9741-58c2-4b64-a088-d1272780099a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:52.646542 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fe1c9741-58c2-4b64-a088-d1272780099a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:52.647317 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fe1c9741-58c2-4b64-a088-d1272780099a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:52.647757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fe1c9741-58c2-4b64-a088-d1272780099a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:52.790896 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-fe1c9741-58c2-4b64-a088-d1272780099a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:52.799803 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-fe1c9741-58c2-4b64-a088-d1272780099a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1691 microversion: 2.1 time: 0.164155 Jun 29 12:37:52.800460 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 264/550] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:52 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:52.834314 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-7b5b7848-cf69-42c0-922e-e7973f64e117 req-2a025d33-7148-4bdf-97cf-15afd7e4cda2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32214b00-153f-4be8-a43b-7babcb3c0ece", "tag": "8007b1cc-4e70-43ea-add8-ccc1e13e5610"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:37:52.842330 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-7b5b7848-cf69-42c0-922e-e7973f64e117 req-2a025d33-7148-4bdf-97cf-15afd7e4cda2 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:52.842809 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-7b5b7848-cf69-42c0-922e-e7973f64e117 req-2a025d33-7148-4bdf-97cf-15afd7e4cda2 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:52.853537 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-7b5b7848-cf69-42c0-922e-e7973f64e117 req-2a025d33-7148-4bdf-97cf-15afd7e4cda2 service nova] Creating event network-changed:8007b1cc-4e70-43ea-add8-ccc1e13e5610 for instance 32214b00-153f-4be8-a43b-7babcb3c0ece on hv-cinder-81268 Jun 29 12:37:52.859203 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-7b5b7848-cf69-42c0-922e-e7973f64e117 req-2a025d33-7148-4bdf-97cf-15afd7e4cda2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028902 Jun 29 12:37:52.859783 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 287/551] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:37:53.817397 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f9af8aaf-d90c-4960-bc63-9dd2a39be9af tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:53.818061 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f9af8aaf-d90c-4960-bc63-9dd2a39be9af tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:53.825239 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f9af8aaf-d90c-4960-bc63-9dd2a39be9af tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:53.825769 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f9af8aaf-d90c-4960-bc63-9dd2a39be9af tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:53.826701 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f9af8aaf-d90c-4960-bc63-9dd2a39be9af tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:53.827382 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f9af8aaf-d90c-4960-bc63-9dd2a39be9af tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:53.955306 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f9af8aaf-d90c-4960-bc63-9dd2a39be9af tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:53.962706 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f9af8aaf-d90c-4960-bc63-9dd2a39be9af tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1691 microversion: 2.1 time: 0.149249 Jun 29 12:37:53.963273 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 265/552] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:53 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1691 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:54.980993 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5ba5bad1-4ac7-468f-bb45-5d7afa46bb2c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:54.981605 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5ba5bad1-4ac7-468f-bb45-5d7afa46bb2c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:54.988236 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5ba5bad1-4ac7-468f-bb45-5d7afa46bb2c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:54.988681 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5ba5bad1-4ac7-468f-bb45-5d7afa46bb2c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:54.989433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5ba5bad1-4ac7-468f-bb45-5d7afa46bb2c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:54.989868 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5ba5bad1-4ac7-468f-bb45-5d7afa46bb2c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:54.993795 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:37:55.119422 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5ba5bad1-4ac7-468f-bb45-5d7afa46bb2c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:55.127486 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5ba5bad1-4ac7-468f-bb45-5d7afa46bb2c tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1691 microversion: 2.1 time: 0.150865 Jun 29 12:37:55.128054 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 288/553] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:54 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:56.144624 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3c18a1a4-d7ba-439d-9f51-ad8c31291701 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:56.145529 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3c18a1a4-d7ba-439d-9f51-ad8c31291701 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:56.152214 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3c18a1a4-d7ba-439d-9f51-ad8c31291701 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:56.152665 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3c18a1a4-d7ba-439d-9f51-ad8c31291701 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:56.153435 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3c18a1a4-d7ba-439d-9f51-ad8c31291701 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:56.153909 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3c18a1a4-d7ba-439d-9f51-ad8c31291701 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:56.449014 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3c18a1a4-d7ba-439d-9f51-ad8c31291701 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:56.457143 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3c18a1a4-d7ba-439d-9f51-ad8c31291701 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1691 microversion: 2.1 time: 0.316390 Jun 29 12:37:56.457707 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 266/554] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:56 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1691 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:57.048700 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-f70ad3d1-7736-4c8a-bc8c-d242b79b7cf6 req-36639940-7915-43eb-a690-2d1d5607f43a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f2e3f4-c3b9-44d5-9648-2a68acec3d2c", "name": "network-vif-deleted", "tag": "e0d184c2-5cac-4f0e-a86b-473ab610d153"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:37:57.058666 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-f70ad3d1-7736-4c8a-bc8c-d242b79b7cf6 req-36639940-7915-43eb-a690-2d1d5607f43a service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:57.059072 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-f70ad3d1-7736-4c8a-bc8c-d242b79b7cf6 req-36639940-7915-43eb-a690-2d1d5607f43a service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:57.078051 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-f70ad3d1-7736-4c8a-bc8c-d242b79b7cf6 req-36639940-7915-43eb-a690-2d1d5607f43a service nova] Creating event network-vif-deleted:e0d184c2-5cac-4f0e-a86b-473ab610d153 for instance 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c on hv-cinder-81268 Jun 29 12:37:57.083421 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-f70ad3d1-7736-4c8a-bc8c-d242b79b7cf6 req-36639940-7915-43eb-a690-2d1d5607f43a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038207 Jun 29 12:37:57.084201 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 289/555] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:37:57.474184 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ab0c1445-ffd1-43dc-b503-dca1d838b28a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:57.474818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ab0c1445-ffd1-43dc-b503-dca1d838b28a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:57.481464 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ab0c1445-ffd1-43dc-b503-dca1d838b28a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:57.481916 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ab0c1445-ffd1-43dc-b503-dca1d838b28a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:57.482758 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ab0c1445-ffd1-43dc-b503-dca1d838b28a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:57.483199 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ab0c1445-ffd1-43dc-b503-dca1d838b28a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:57.517140 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ab0c1445-ffd1-43dc-b503-dca1d838b28a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:57.517851 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ab0c1445-ffd1-43dc-b503-dca1d838b28a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:57.518307 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-ab0c1445-ffd1-43dc-b503-dca1d838b28a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lazy-loading 'fault' on Instance uuid 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 12:37:57.568024 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ab0c1445-ffd1-43dc-b503-dca1d838b28a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:37:57.574839 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ab0c1445-ffd1-43dc-b503-dca1d838b28a tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 200 len: 1336 microversion: 2.1 time: 0.104426 Jun 29 12:37:57.575609 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 267/556] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:57 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 1336 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:37:58.593753 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-bcd68440-dab6-42cb-8105-9d987b9aeb73 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:58.594475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-bcd68440-dab6-42cb-8105-9d987b9aeb73 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:37:58.600693 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bcd68440-dab6-42cb-8105-9d987b9aeb73 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:58.601141 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bcd68440-dab6-42cb-8105-9d987b9aeb73 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:58.601931 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bcd68440-dab6-42cb-8105-9d987b9aeb73 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:37:58.602370 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bcd68440-dab6-42cb-8105-9d987b9aeb73 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:37:58.615884 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-bcd68440-dab6-42cb-8105-9d987b9aeb73 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] HTTP exception thrown: Instance 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c could not be found. Jun 29 12:37:58.617423 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-bcd68440-dab6-42cb-8105-9d987b9aeb73 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Request method failure captured: Jun 29 12:37:58.617423 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c HTTP/1.1 Jun 29 12:37:58.617423 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:37:58.617423 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:37:58.617423 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:37:58.617423 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:37:58.617423 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:37:58.617423 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:37:58.617423 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:37:58.617423 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:37:58.617423 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEabg5iVMEbOJzCwdOCwPxnKhRE8xvAH6FjMNwILYHvgdAsYTJbCxQBGWRog2gvt81PgL8lF8nPUVAT6C20WS8IP2YDtPNfSU3z3-biFYl82u8OpR9Rn0KOwxc725AZY3ac1c00Qu2nph6va0WgPmO9r1VgnqYNalOsYrn_-l7oCAZY Jun 29 12:37:58.617423 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:37:58.617423 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:37:58.617423 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:37:58.617423 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:37:58.617423 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:37:58.617423 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:37:58.617423 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: 8be6d4a4e2344e25b7661d69a9e222c8 Jun 29 12:37:58.617423 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-117238858 Jun 29 12:37:58.617423 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:37:58.617423 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:37:58.619061 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8be6d4a4e2344e25b7661d69a9e222c8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8be6d4a4e2344e25b7661d69a9e222c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8be6d4a4e2344e25b7661d69a9e222c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8be6d4a4e2344e25b7661d69a9e222c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:37:58.619061 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-ServerRescueNegativeTestJSON-117238858 Jun 29 12:37:58.619061 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 8be6d4a4e2344e25b7661d69a9e222c8 Jun 29 12:37:58.619061 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-117238858 Jun 29 12:37:58.619061 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-ServerRescueNegativeTestJSON-117238858-project Jun 29 12:37:58.619061 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:37:58.619061 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:37:58.619061 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: 350a57ee307a4419974dcecf37e466e5 Jun 29 12:37:58.619061 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-ServerRescueNegativeTestJSON-117238858-project Jun 29 12:37:58.619061 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:37:58.619061 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Instance 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c could not be found. Jun 29 12:37:58.619061 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': '44f2e3f4-c3b9-44d5-9648-2a68acec3d2c'} Jun 29 12:37:58.620712 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:37:58.620712 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:37:58.620712 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:37:58.620712 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:37:58.620712 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:37:58.620712 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:37:58.620712 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:37:58.620712 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:37:58.620712 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:37:58.620712 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:37:58.620712 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c could not be found. Jun 29 12:37:58.620712 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:37:58.620712 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:37:58.620712 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:37:58.620712 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:37:58.620712 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:37:58.620712 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:37:58.620712 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:37:58.620712 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:37:58.620712 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:37:58.622180 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:37:58.622180 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:37:58.622180 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:37:58.622180 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:37:58.622180 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:37:58.622180 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:37:58.622180 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:37:58.622180 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c could not be found. Jun 29 12:37:58.622180 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:37:58.622180 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:37:58.622180 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:37:58.622180 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:37:58.622180 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:37:58.622180 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:37:58.622180 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:37:58.622180 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:37:58.622180 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c could not be found. Jun 29 12:37:58.622180 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:37:58.623421 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-bcd68440-dab6-42cb-8105-9d987b9aeb73 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Returning 404 to user: Instance 44f2e3f4-c3b9-44d5-9648-2a68acec3d2c could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:37:58.623421 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-bcd68440-dab6-42cb-8105-9d987b9aeb73 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c" status: 404 len: 111 microversion: 2.1 time: 0.029850 Jun 29 12:37:58.623421 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 290/557] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:37:58 2022] GET /compute/v2.1/servers/44f2e3f4-c3b9-44d5-9648-2a68acec3d2c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:37:58.627656 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8ed728c2-c991-472c-a80f-70f5e8bc3720 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '.version_select at 0x7fdb06a1edc0>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:37:58.645664 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8ed728c2-c991-472c-a80f-70f5e8bc3720 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1758771067" status: 202 len: 0 microversion: 2.1 time: 0.021605 Jun 29 12:37:58.646224 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 268/558] 10.222.0.52 () {58 vars in 1220 bytes} [Wed Jun 29 12:37:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1758771067 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:38:01.746165 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-dfcff1f3-538a-44db-bea5-1c82872a7ee4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:01.746733 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-dfcff1f3-538a-44db-bea5-1c82872a7ee4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:01.753433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dfcff1f3-538a-44db-bea5-1c82872a7ee4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:01.753882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dfcff1f3-538a-44db-bea5-1c82872a7ee4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:01.754749 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dfcff1f3-538a-44db-bea5-1c82872a7ee4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:01.755189 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dfcff1f3-538a-44db-bea5-1c82872a7ee4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:01.780893 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-dfcff1f3-538a-44db-bea5-1c82872a7ee4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Going to try to terminate instance {{(pid=124317) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 12:38:01.853890 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-dfcff1f3-538a-44db-bea5-1c82872a7ee4 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 204 len: 0 microversion: 2.1 time: 0.111181 Jun 29 12:38:01.854917 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 291/559] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:38:01 2022] DELETE /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 12:38:01.864685 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3afb76df-0acd-427c-872a-604b7979b47d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:01.865297 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3afb76df-0acd-427c-872a-604b7979b47d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:01.871271 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3afb76df-0acd-427c-872a-604b7979b47d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:01.871717 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3afb76df-0acd-427c-872a-604b7979b47d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:01.872475 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3afb76df-0acd-427c-872a-604b7979b47d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:01.874100 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3afb76df-0acd-427c-872a-604b7979b47d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:02.000570 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3afb76df-0acd-427c-872a-604b7979b47d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:02.008035 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3afb76df-0acd-427c-872a-604b7979b47d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1507 microversion: 2.1 time: 0.147892 Jun 29 12:38:02.008596 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 269/560] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:01 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:03.025931 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-43b99143-84b3-4e0b-8f8f-5e9e8f2c0817 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:03.026691 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-43b99143-84b3-4e0b-8f8f-5e9e8f2c0817 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:03.028625 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=3 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:38:03.034907 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-43b99143-84b3-4e0b-8f8f-5e9e8f2c0817 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:03.035371 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-43b99143-84b3-4e0b-8f8f-5e9e8f2c0817 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:03.036116 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-43b99143-84b3-4e0b-8f8f-5e9e8f2c0817 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:03.036577 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-43b99143-84b3-4e0b-8f8f-5e9e8f2c0817 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:03.166701 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-43b99143-84b3-4e0b-8f8f-5e9e8f2c0817 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:03.174936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-43b99143-84b3-4e0b-8f8f-5e9e8f2c0817 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1507 microversion: 2.1 time: 0.153248 Jun 29 12:38:03.175496 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 292/561] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:03 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:04.191814 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-66b1b8c3-cbd2-40f0-b7c6-8b6510299b2d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:04.192419 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-66b1b8c3-cbd2-40f0-b7c6-8b6510299b2d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:04.199030 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-66b1b8c3-cbd2-40f0-b7c6-8b6510299b2d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:04.199487 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-66b1b8c3-cbd2-40f0-b7c6-8b6510299b2d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:04.200258 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-66b1b8c3-cbd2-40f0-b7c6-8b6510299b2d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:04.200700 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-66b1b8c3-cbd2-40f0-b7c6-8b6510299b2d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:04.410401 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-66b1b8c3-cbd2-40f0-b7c6-8b6510299b2d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:04.417814 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-66b1b8c3-cbd2-40f0-b7c6-8b6510299b2d tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 200 len: 1507 microversion: 2.1 time: 0.229883 Jun 29 12:38:04.418386 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 270/562] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:04 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 1507 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:04.631356 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-89ec2392-d573-4f2b-9f76-ee7def5706a6 req-c6979572-ffe0-473f-bce3-607e7eb1e018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d59927-1de5-433d-8c94-5bf3aab49f49", "name": "network-vif-deleted", "tag": "ab0649e0-5f8b-479c-990a-de8e68bba496"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:38:04.640822 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-89ec2392-d573-4f2b-9f76-ee7def5706a6 req-c6979572-ffe0-473f-bce3-607e7eb1e018 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:04.641344 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-89ec2392-d573-4f2b-9f76-ee7def5706a6 req-c6979572-ffe0-473f-bce3-607e7eb1e018 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:04.655483 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-89ec2392-d573-4f2b-9f76-ee7def5706a6 req-c6979572-ffe0-473f-bce3-607e7eb1e018 service nova] Creating event network-vif-deleted:ab0649e0-5f8b-479c-990a-de8e68bba496 for instance d6d59927-1de5-433d-8c94-5bf3aab49f49 on hv-cinder-81268 Jun 29 12:38:04.661450 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-89ec2392-d573-4f2b-9f76-ee7def5706a6 req-c6979572-ffe0-473f-bce3-607e7eb1e018 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033404 Jun 29 12:38:04.662634 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 293/563] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:38:05.434663 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-7beb7f09-3aee-4a25-b561-29ab4aefd3b8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:05.436178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-7beb7f09-3aee-4a25-b561-29ab4aefd3b8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: d6d59927-1de5-433d-8c94-5bf3aab49f49] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:05.442757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7beb7f09-3aee-4a25-b561-29ab4aefd3b8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:05.443202 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7beb7f09-3aee-4a25-b561-29ab4aefd3b8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:05.443957 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7beb7f09-3aee-4a25-b561-29ab4aefd3b8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:05.444444 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7beb7f09-3aee-4a25-b561-29ab4aefd3b8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:05.459646 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-7beb7f09-3aee-4a25-b561-29ab4aefd3b8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] HTTP exception thrown: Instance d6d59927-1de5-433d-8c94-5bf3aab49f49 could not be found. Jun 29 12:38:05.461267 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-7beb7f09-3aee-4a25-b561-29ab4aefd3b8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Request method failure captured: Jun 29 12:38:05.461267 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 HTTP/1.1 Jun 29 12:38:05.461267 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept: application/json Jun 29 12:38:05.461267 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jun 29 12:38:05.461267 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Connection: close Jun 29 12:38:05.461267 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jun 29 12:38:05.461267 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jun 29 12:38:05.461267 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Host: 10.222.0.52 Jun 29 12:38:05.461267 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jun 29 12:38:05.461267 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jun 29 12:38:05.461267 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivEabg5iVMEbOJzCwdOCwPxnKhRE8xvAH6FjMNwILYHvgdAsYTJbCxQBGWRog2gvt81PgL8lF8nPUVAT6C20WS8IP2YDtPNfSU3z3-biFYl82u8OpR9Rn0KOwxc725AZY3ac1c00Qu2nph6va0WgPmO9r1VgnqYNalOsYrn_-l7oCAZY Jun 29 12:38:05.461267 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jun 29 12:38:05.461267 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jun 29 12:38:05.461267 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jun 29 12:38:05.461267 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jun 29 12:38:05.461267 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jun 29 12:38:05.461267 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jun 29 12:38:05.461267 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Id: 8be6d4a4e2344e25b7661d69a9e222c8 Jun 29 12:38:05.461267 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-117238858 Jun 29 12:38:05.461267 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jun 29 12:38:05.461267 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jun 29 12:38:05.462857 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8be6d4a4e2344e25b7661d69a9e222c8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8be6d4a4e2344e25b7661d69a9e222c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8be6d4a4e2344e25b7661d69a9e222c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8be6d4a4e2344e25b7661d69a9e222c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:38:05.462857 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-ServerRescueNegativeTestJSON-117238858 Jun 29 12:38:05.462857 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Id: 8be6d4a4e2344e25b7661d69a9e222c8 Jun 29 12:38:05.462857 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-117238858 Jun 29 12:38:05.462857 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User: tempest-ServerRescueNegativeTestJSON-117238858-project Jun 29 12:38:05.462857 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jun 29 12:38:05.462857 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jun 29 12:38:05.462857 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Id: 350a57ee307a4419974dcecf37e466e5 Jun 29 12:38:05.462857 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-ServerRescueNegativeTestJSON-117238858-project Jun 29 12:38:05.462857 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: method: > Jun 29 12:38:05.462857 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: exception: Instance d6d59927-1de5-433d-8c94-5bf3aab49f49 could not be found. Jun 29 12:38:05.462857 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: action_args: {'id': 'd6d59927-1de5-433d-8c94-5bf3aab49f49'} Jun 29 12:38:05.464029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:38:05.464029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:38:05.464029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:38:05.464029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:38:05.464029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:38:05.464029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:38:05.464029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:38:05.464029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:38:05.464029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:38:05.464029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:38:05.464029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6d59927-1de5-433d-8c94-5bf3aab49f49 could not be found. Jun 29 12:38:05.464029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:38:05.464029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:38:05.464029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:38:05.464029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:38:05.464029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:38:05.464029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:38:05.464029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:38:05.464029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:38:05.464029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:38:05.465499 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:38:05.465499 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:38:05.465499 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:38:05.465499 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:38:05.465499 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:38:05.465499 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:38:05.465499 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:38:05.465499 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6d59927-1de5-433d-8c94-5bf3aab49f49 could not be found. Jun 29 12:38:05.465499 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:38:05.465499 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:38:05.465499 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:38:05.465499 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:38:05.465499 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:38:05.465499 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:38:05.465499 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:38:05.465499 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:38:05.465499 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6d59927-1de5-433d-8c94-5bf3aab49f49 could not be found. Jun 29 12:38:05.465499 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:38:05.467170 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-7beb7f09-3aee-4a25-b561-29ab4aefd3b8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Returning 404 to user: Instance d6d59927-1de5-433d-8c94-5bf3aab49f49 could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:38:05.467170 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-7beb7f09-3aee-4a25-b561-29ab4aefd3b8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49" status: 404 len: 111 microversion: 2.1 time: 0.031888 Jun 29 12:38:05.467170 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 271/564] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:05 2022] GET /compute/v2.1/servers/d6d59927-1de5-433d-8c94-5bf3aab49f49 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:38:05.471679 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-99a0958b-ac2e-4435-bed2-374d69b96ed3 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:05.472264 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-99a0958b-ac2e-4435-bed2-374d69b96ed3 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:05.478589 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-99a0958b-ac2e-4435-bed2-374d69b96ed3 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:05.479044 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-99a0958b-ac2e-4435-bed2-374d69b96ed3 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:05.479800 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-99a0958b-ac2e-4435-bed2-374d69b96ed3 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:05.480240 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-99a0958b-ac2e-4435-bed2-374d69b96ed3 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:05.506511 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-99a0958b-ac2e-4435-bed2-374d69b96ed3 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Going to try to terminate instance {{(pid=124317) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 12:38:05.580406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-99a0958b-ac2e-4435-bed2-374d69b96ed3 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 204 len: 0 microversion: 2.1 time: 0.112651 Jun 29 12:38:05.580998 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 294/565] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:38:05 2022] DELETE /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 12:38:05.589123 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d9b3f179-f595-456a-a0b7-96e41d4159d8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:05.589937 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d9b3f179-f595-456a-a0b7-96e41d4159d8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:05.596002 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d9b3f179-f595-456a-a0b7-96e41d4159d8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:05.596453 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d9b3f179-f595-456a-a0b7-96e41d4159d8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:05.597209 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d9b3f179-f595-456a-a0b7-96e41d4159d8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:05.597645 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d9b3f179-f595-456a-a0b7-96e41d4159d8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:05.735639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d9b3f179-f595-456a-a0b7-96e41d4159d8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:05.737944 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:38:05.744253 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d9b3f179-f595-456a-a0b7-96e41d4159d8 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1523 microversion: 2.1 time: 0.158953 Jun 29 12:38:05.744816 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 272/566] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:05 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:06.762529 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6c6f9a02-8c0d-45a0-ae80-250dcce58e3f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:06.763274 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-6c6f9a02-8c0d-45a0-ae80-250dcce58e3f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:06.770487 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6c6f9a02-8c0d-45a0-ae80-250dcce58e3f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:06.770958 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6c6f9a02-8c0d-45a0-ae80-250dcce58e3f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:06.771707 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6c6f9a02-8c0d-45a0-ae80-250dcce58e3f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:06.772144 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6c6f9a02-8c0d-45a0-ae80-250dcce58e3f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:06.907195 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6c6f9a02-8c0d-45a0-ae80-250dcce58e3f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:06.914594 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6c6f9a02-8c0d-45a0-ae80-250dcce58e3f tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1523 microversion: 2.1 time: 0.156339 Jun 29 12:38:06.915157 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 295/567] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:06 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:07.932021 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e120407f-76b8-42bb-aa90-dbfe7204b8a5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:07.932614 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e120407f-76b8-42bb-aa90-dbfe7204b8a5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:07.940370 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e120407f-76b8-42bb-aa90-dbfe7204b8a5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:07.940816 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e120407f-76b8-42bb-aa90-dbfe7204b8a5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:07.941568 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e120407f-76b8-42bb-aa90-dbfe7204b8a5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:07.942005 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e120407f-76b8-42bb-aa90-dbfe7204b8a5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:08.070229 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e120407f-76b8-42bb-aa90-dbfe7204b8a5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:08.078937 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e120407f-76b8-42bb-aa90-dbfe7204b8a5 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1523 microversion: 2.1 time: 0.150913 Jun 29 12:38:08.079497 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 273/568] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:07 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:09.095627 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-55d984e0-b399-47b0-a52b-2c7a4afd6cea tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:09.096241 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-55d984e0-b399-47b0-a52b-2c7a4afd6cea tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:09.102106 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-55d984e0-b399-47b0-a52b-2c7a4afd6cea tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:09.102592 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-55d984e0-b399-47b0-a52b-2c7a4afd6cea tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:09.103363 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-55d984e0-b399-47b0-a52b-2c7a4afd6cea tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:09.103811 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-55d984e0-b399-47b0-a52b-2c7a4afd6cea tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:09.239537 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-55d984e0-b399-47b0-a52b-2c7a4afd6cea tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350a57ee307a4419974dcecf37e466e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be6d4a4e2344e25b7661d69a9e222c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:09.246926 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-55d984e0-b399-47b0-a52b-2c7a4afd6cea tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 200 len: 1523 microversion: 2.1 time: 0.155190 Jun 29 12:38:09.247510 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 296/569] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:09 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:09.423916 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-e98d2cc3-2212-4749-94e7-dc58da26ffc7 req-2f4dbd2a-ed53-4e92-b8b3-cf378e00c06b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2fe6e32-c192-444c-8fa1-df3767145bc0", "name": "network-vif-deleted", "tag": "1e5740b0-fd73-4bb9-8d83-8f4bdfb7b8ed"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:38:09.432101 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-e98d2cc3-2212-4749-94e7-dc58da26ffc7 req-2f4dbd2a-ed53-4e92-b8b3-cf378e00c06b service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:09.432578 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-e98d2cc3-2212-4749-94e7-dc58da26ffc7 req-2f4dbd2a-ed53-4e92-b8b3-cf378e00c06b service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:09.444662 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-e98d2cc3-2212-4749-94e7-dc58da26ffc7 req-2f4dbd2a-ed53-4e92-b8b3-cf378e00c06b service nova] Creating event network-vif-deleted:1e5740b0-fd73-4bb9-8d83-8f4bdfb7b8ed for instance f2fe6e32-c192-444c-8fa1-df3767145bc0 on hv-cinder-81268 Jun 29 12:38:09.449916 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-e98d2cc3-2212-4749-94e7-dc58da26ffc7 req-2f4dbd2a-ed53-4e92-b8b3-cf378e00c06b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030428 Jun 29 12:38:09.450526 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 274/570] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:38:10.265017 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-88b3c045-7a21-45d6-9a03-4b2fe4277c39 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:10.265657 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-88b3c045-7a21-45d6-9a03-4b2fe4277c39 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] [instance: f2fe6e32-c192-444c-8fa1-df3767145bc0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:10.271945 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-88b3c045-7a21-45d6-9a03-4b2fe4277c39 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:10.272390 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-88b3c045-7a21-45d6-9a03-4b2fe4277c39 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:10.273167 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-88b3c045-7a21-45d6-9a03-4b2fe4277c39 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:10.273579 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-88b3c045-7a21-45d6-9a03-4b2fe4277c39 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:10.287098 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-88b3c045-7a21-45d6-9a03-4b2fe4277c39 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] HTTP exception thrown: Instance f2fe6e32-c192-444c-8fa1-df3767145bc0 could not be found. Jun 29 12:38:10.288720 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-88b3c045-7a21-45d6-9a03-4b2fe4277c39 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Request method failure captured: Jun 29 12:38:10.288720 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 HTTP/1.1 Jun 29 12:38:10.288720 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:38:10.288720 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:38:10.288720 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:38:10.288720 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:38:10.288720 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:38:10.288720 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:38:10.288720 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:38:10.288720 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:38:10.288720 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEabg5iVMEbOJzCwdOCwPxnKhRE8xvAH6FjMNwILYHvgdAsYTJbCxQBGWRog2gvt81PgL8lF8nPUVAT6C20WS8IP2YDtPNfSU3z3-biFYl82u8OpR9Rn0KOwxc725AZY3ac1c00Qu2nph6va0WgPmO9r1VgnqYNalOsYrn_-l7oCAZY Jun 29 12:38:10.288720 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:38:10.288720 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:38:10.288720 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:38:10.288720 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:38:10.288720 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:38:10.288720 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:38:10.288720 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: 8be6d4a4e2344e25b7661d69a9e222c8 Jun 29 12:38:10.288720 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-117238858 Jun 29 12:38:10.288720 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:38:10.288720 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:38:10.290292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8be6d4a4e2344e25b7661d69a9e222c8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8be6d4a4e2344e25b7661d69a9e222c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8be6d4a4e2344e25b7661d69a9e222c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8be6d4a4e2344e25b7661d69a9e222c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:38:10.290292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-ServerRescueNegativeTestJSON-117238858 Jun 29 12:38:10.290292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 8be6d4a4e2344e25b7661d69a9e222c8 Jun 29 12:38:10.290292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-117238858 Jun 29 12:38:10.290292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-ServerRescueNegativeTestJSON-117238858-project Jun 29 12:38:10.290292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:38:10.290292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:38:10.290292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: 350a57ee307a4419974dcecf37e466e5 Jun 29 12:38:10.290292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-ServerRescueNegativeTestJSON-117238858-project Jun 29 12:38:10.290292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:38:10.290292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Instance f2fe6e32-c192-444c-8fa1-df3767145bc0 could not be found. Jun 29 12:38:10.290292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': 'f2fe6e32-c192-444c-8fa1-df3767145bc0'} Jun 29 12:38:10.291350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:38:10.291350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:38:10.291350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:38:10.291350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:38:10.291350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:38:10.291350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:38:10.291350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:38:10.291350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:38:10.291350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:38:10.291350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:38:10.291350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2fe6e32-c192-444c-8fa1-df3767145bc0 could not be found. Jun 29 12:38:10.291350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:38:10.291350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:38:10.291350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:38:10.291350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:38:10.291350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:38:10.291350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:38:10.291350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:38:10.291350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:38:10.291350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:38:10.292759 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:38:10.292759 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:38:10.292759 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:38:10.292759 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:38:10.292759 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:38:10.292759 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:38:10.292759 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:38:10.292759 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2fe6e32-c192-444c-8fa1-df3767145bc0 could not be found. Jun 29 12:38:10.292759 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:38:10.292759 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:38:10.292759 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:38:10.292759 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:38:10.292759 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:38:10.292759 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:38:10.292759 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:38:10.292759 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:38:10.292759 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2fe6e32-c192-444c-8fa1-df3767145bc0 could not be found. Jun 29 12:38:10.292759 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:38:10.294262 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-88b3c045-7a21-45d6-9a03-4b2fe4277c39 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] Returning 404 to user: Instance f2fe6e32-c192-444c-8fa1-df3767145bc0 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:38:10.294262 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-88b3c045-7a21-45d6-9a03-4b2fe4277c39 tempest-ServerRescueNegativeTestJSON-117238858 tempest-ServerRescueNegativeTestJSON-117238858-project] 10.222.0.52 "GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0" status: 404 len: 111 microversion: 2.1 time: 0.029551 Jun 29 12:38:10.294262 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 297/571] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:10 2022] GET /compute/v2.1/servers/f2fe6e32-c192-444c-8fa1-df3767145bc0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:38:18.961571 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-989f1f18-b1a4-4f5a-9041-af7f32c47f20 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Action: 'create', calling method: .version_select at 0x7fdb06a5f940>, body: {"keypair": {"name": "tempest-keypair-1245302347", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7MoZwepzFq5TzClj3YiW5YSViQBepBVJoI/GGspyHtEBG6oO8yL+sui72pu8Mh4RKh1iQM1A8r0VwgeU59L5XCgMhejEzoGs1gvwhYxA3j00UtUBH+kbDnBaHomSS4lg=="}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:38:18.965683 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:38:18.983421 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-989f1f18-b1a4-4f5a-9041-af7f32c47f20 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Getting quotas for project f18ffa75c23e4276a8b5b4fc3821fb87. Resources: {'key_pairs'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:38:18.987542 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-989f1f18-b1a4-4f5a-9041-af7f32c47f20 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Getting quotas for user 2af4d4a69e9d4755bff61401f4349c78 and project f18ffa75c23e4276a8b5b4fc3821fb87. Resources: {'key_pairs'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:38:19.011586 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-989f1f18-b1a4-4f5a-9041-af7f32c47f20 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.203692 Jun 29 12:38:19.012189 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 275/572] 10.222.0.52 () {60 vars in 1158 bytes} [Wed Jun 29 12:38:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:38:20.447473 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-956e8ce9-e082-4505-886e-98d844b6b27d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:38:20.448113 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-956e8ce9-e082-4505-886e-98d844b6b27d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:20.450223 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:38:20.451447 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:38:20.461008 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-956e8ce9-e082-4505-886e-98d844b6b27d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:20.461806 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-956e8ce9-e082-4505-886e-98d844b6b27d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:20.462275 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-956e8ce9-e082-4505-886e-98d844b6b27d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:20.462714 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-956e8ce9-e082-4505-886e-98d844b6b27d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:20.495805 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-956e8ce9-e082-4505-886e-98d844b6b27d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lazy-loading 'flavor' on Instance uuid 72186d8a-10a4-4b4a-b57e-6e8e520dc784 {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 12:38:20.577464 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-956e8ce9-e082-4505-886e-98d844b6b27d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "POST /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784/action" status: 202 len: 0 microversion: 2.1 time: 0.133735 Jun 29 12:38:20.578096 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 298/573] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 12:38:20 2022] POST /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:38:20.586796 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-2b0246d9-554c-4f01-a6bb-5b8037bc8be1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:20.587676 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-2b0246d9-554c-4f01-a6bb-5b8037bc8be1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:20.591597 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a026fc86-7a2e-4fa6-be3f-581243dd29fd tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-261994520", "imageRef": "70887696-f652-46b0-a5be-bfb400986078", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a4c9384-2272-4ef8-9e7c-74de83b9d3b0"}], "security_groups": [{"name": "tempest-securitygroup--1651326674"}], "key_name": "tempest-keypair-1245302347", "user_data": "}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:38:20.594736 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2b0246d9-554c-4f01-a6bb-5b8037bc8be1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:20.595458 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2b0246d9-554c-4f01-a6bb-5b8037bc8be1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:20.596363 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2b0246d9-554c-4f01-a6bb-5b8037bc8be1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:20.596865 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2b0246d9-554c-4f01-a6bb-5b8037bc8be1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:20.606278 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=9 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:38:20.858213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2b0246d9-554c-4f01-a6bb-5b8037bc8be1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:20.871857 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-2b0246d9-554c-4f01-a6bb-5b8037bc8be1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1568 microversion: 2.1 time: 0.288914 Jun 29 12:38:20.873538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 299/574] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:20 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1568 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:20.898104 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.network.neutron [None req-a026fc86-7a2e-4fa6-be3f-581243dd29fd tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] validate_networks() for [('9a4c9384-2272-4ef8-9e7c-74de83b9d3b0', None, None, None, None, None)] {{(pid=124316) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 12:38:21.582593 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-a026fc86-7a2e-4fa6-be3f-581243dd29fd tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Flavor limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 12:38:21.583023 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-a026fc86-7a2e-4fa6-be3f-581243dd29fd tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Image limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 12:38:21.583494 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-a026fc86-7a2e-4fa6-be3f-581243dd29fd tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Flavor pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 12:38:21.584074 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-a026fc86-7a2e-4fa6-be3f-581243dd29fd tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Image pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 12:38:21.584488 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-a026fc86-7a2e-4fa6-be3f-581243dd29fd tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 12:38:21.594967 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a026fc86-7a2e-4fa6-be3f-581243dd29fd tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:21.595614 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a026fc86-7a2e-4fa6-be3f-581243dd29fd tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:21.596485 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a026fc86-7a2e-4fa6-be3f-581243dd29fd tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:21.596619 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a026fc86-7a2e-4fa6-be3f-581243dd29fd tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:21.616722 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-a026fc86-7a2e-4fa6-be3f-581243dd29fd tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Getting quotas for project f18ffa75c23e4276a8b5b4fc3821fb87. Resources: {'cores', 'ram', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:38:21.621411 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-a026fc86-7a2e-4fa6-be3f-581243dd29fd tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Getting quotas for user 2af4d4a69e9d4755bff61401f4349c78 and project f18ffa75c23e4276a8b5b4fc3821fb87. Resources: {'cores', 'ram', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:38:21.635587 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a026fc86-7a2e-4fa6-be3f-581243dd29fd tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Going to run 1 instances... {{(pid=124316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 12:38:21.639167 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a026fc86-7a2e-4fa6-be3f-581243dd29fd tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: c8419121-12d7-431e-9ff0-dfa04c64cd00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70887696-f652-46b0-a5be-bfb400986078',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 12:38:21.690587 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a026fc86-7a2e-4fa6-be3f-581243dd29fd tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.108407 Jun 29 12:38:21.691929 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 276/575] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 12:38:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 29 12:38:21.703307 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6138dd30-fa92-47c4-b31e-a48df2a4143c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:21.704008 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-6138dd30-fa92-47c4-b31e-a48df2a4143c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: c8419121-12d7-431e-9ff0-dfa04c64cd00] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:21.764182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6138dd30-fa92-47c4-b31e-a48df2a4143c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:21.771647 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6138dd30-fa92-47c4-b31e-a48df2a4143c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00" status: 200 len: 1241 microversion: 2.1 time: 0.073708 Jun 29 12:38:21.772528 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 300/576] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:21 2022] GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:21.890193 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c96e896c-c4f4-4e23-be48-360348e682ae tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:21.891256 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c96e896c-c4f4-4e23-be48-360348e682ae tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:21.902643 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c96e896c-c4f4-4e23-be48-360348e682ae tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:21.904650 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c96e896c-c4f4-4e23-be48-360348e682ae tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:21.905748 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c96e896c-c4f4-4e23-be48-360348e682ae tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:21.906351 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c96e896c-c4f4-4e23-be48-360348e682ae tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:22.102504 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c96e896c-c4f4-4e23-be48-360348e682ae tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:22.113037 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c96e896c-c4f4-4e23-be48-360348e682ae tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1568 microversion: 2.1 time: 0.226900 Jun 29 12:38:22.114457 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 277/577] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:21 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:22.788729 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-89a0a645-48d4-4d15-a471-74add9fa0567 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:22.790199 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-89a0a645-48d4-4d15-a471-74add9fa0567 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: c8419121-12d7-431e-9ff0-dfa04c64cd00] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:22.801626 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-89a0a645-48d4-4d15-a471-74add9fa0567 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:22.802085 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-89a0a645-48d4-4d15-a471-74add9fa0567 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:22.803096 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-89a0a645-48d4-4d15-a471-74add9fa0567 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:22.803532 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-89a0a645-48d4-4d15-a471-74add9fa0567 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:22.886300 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-89a0a645-48d4-4d15-a471-74add9fa0567 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:22.895574 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-89a0a645-48d4-4d15-a471-74add9fa0567 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00" status: 200 len: 1301 microversion: 2.1 time: 0.110683 Jun 29 12:38:22.896077 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 301/578] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:22 2022] GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00 => generated 1301 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:23.130405 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3c16fcef-8b7b-4c3a-b97f-66b0885e9552 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:23.131047 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3c16fcef-8b7b-4c3a-b97f-66b0885e9552 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:23.138941 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3c16fcef-8b7b-4c3a-b97f-66b0885e9552 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:23.139396 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3c16fcef-8b7b-4c3a-b97f-66b0885e9552 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:23.140239 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3c16fcef-8b7b-4c3a-b97f-66b0885e9552 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:23.140743 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3c16fcef-8b7b-4c3a-b97f-66b0885e9552 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:23.363704 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3c16fcef-8b7b-4c3a-b97f-66b0885e9552 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:23.371735 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3c16fcef-8b7b-4c3a-b97f-66b0885e9552 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1568 microversion: 2.1 time: 0.245135 Jun 29 12:38:23.373252 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 278/579] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:23 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:23.913155 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e68bb227-84ce-440c-a4be-08c008b34590 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:23.913786 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e68bb227-84ce-440c-a4be-08c008b34590 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: c8419121-12d7-431e-9ff0-dfa04c64cd00] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:23.920541 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e68bb227-84ce-440c-a4be-08c008b34590 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:23.921052 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e68bb227-84ce-440c-a4be-08c008b34590 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:23.921832 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e68bb227-84ce-440c-a4be-08c008b34590 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:23.922274 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e68bb227-84ce-440c-a4be-08c008b34590 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:24.059662 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e68bb227-84ce-440c-a4be-08c008b34590 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:24.071303 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e68bb227-84ce-440c-a4be-08c008b34590 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00" status: 200 len: 1367 microversion: 2.1 time: 0.161981 Jun 29 12:38:24.074857 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 302/580] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:23 2022] GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:24.332039 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-d6d39475-3359-4860-83a6-baf15310ef6d req-e4b63074-d678-4c61-a6e5-51a0c3644840 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8419121-12d7-431e-9ff0-dfa04c64cd00", "tag": "96254a3e-9e71-4d23-acc2-9c889cabe601"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:38:24.347034 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-d6d39475-3359-4860-83a6-baf15310ef6d req-e4b63074-d678-4c61-a6e5-51a0c3644840 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:24.347482 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-d6d39475-3359-4860-83a6-baf15310ef6d req-e4b63074-d678-4c61-a6e5-51a0c3644840 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:24.368494 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-d6d39475-3359-4860-83a6-baf15310ef6d req-e4b63074-d678-4c61-a6e5-51a0c3644840 service nova] Creating event network-changed:96254a3e-9e71-4d23-acc2-9c889cabe601 for instance c8419121-12d7-431e-9ff0-dfa04c64cd00 on hv-cinder-81268 Jun 29 12:38:24.382637 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-d6d39475-3359-4860-83a6-baf15310ef6d req-e4b63074-d678-4c61-a6e5-51a0c3644840 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054043 Jun 29 12:38:24.383244 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 279/581] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:38:24.390955 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-18399836-d2dc-4fe8-bdaa-0072c0d0aa9e tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:24.393237 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-18399836-d2dc-4fe8-bdaa-0072c0d0aa9e tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:24.400085 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-18399836-d2dc-4fe8-bdaa-0072c0d0aa9e tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:24.400530 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-18399836-d2dc-4fe8-bdaa-0072c0d0aa9e tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:24.402291 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-18399836-d2dc-4fe8-bdaa-0072c0d0aa9e tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:24.402807 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-18399836-d2dc-4fe8-bdaa-0072c0d0aa9e tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:24.553947 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-18399836-d2dc-4fe8-bdaa-0072c0d0aa9e tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:24.562344 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-18399836-d2dc-4fe8-bdaa-0072c0d0aa9e tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1568 microversion: 2.1 time: 0.176858 Jun 29 12:38:24.562908 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 303/582] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:24 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:25.088742 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-bd11d12d-a1cc-4a56-8d91-302eb2466615 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:25.089442 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-bd11d12d-a1cc-4a56-8d91-302eb2466615 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: c8419121-12d7-431e-9ff0-dfa04c64cd00] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:25.096930 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bd11d12d-a1cc-4a56-8d91-302eb2466615 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:25.097377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bd11d12d-a1cc-4a56-8d91-302eb2466615 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:25.098139 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bd11d12d-a1cc-4a56-8d91-302eb2466615 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:25.098617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bd11d12d-a1cc-4a56-8d91-302eb2466615 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:25.232803 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-bd11d12d-a1cc-4a56-8d91-302eb2466615 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:25.240125 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-bd11d12d-a1cc-4a56-8d91-302eb2466615 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00" status: 200 len: 1367 microversion: 2.1 time: 0.155602 Jun 29 12:38:25.240683 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 280/583] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:25 2022] GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:25.579216 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-dd6408b6-61cc-465d-bf16-3062b86a1b8d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:25.579824 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-dd6408b6-61cc-465d-bf16-3062b86a1b8d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:25.585808 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dd6408b6-61cc-465d-bf16-3062b86a1b8d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:25.586263 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dd6408b6-61cc-465d-bf16-3062b86a1b8d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:25.587050 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dd6408b6-61cc-465d-bf16-3062b86a1b8d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:25.587488 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dd6408b6-61cc-465d-bf16-3062b86a1b8d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:25.719325 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-dd6408b6-61cc-465d-bf16-3062b86a1b8d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:25.726767 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-dd6408b6-61cc-465d-bf16-3062b86a1b8d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1568 microversion: 2.1 time: 0.151510 Jun 29 12:38:25.727323 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 304/584] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:25 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:26.256699 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-70b0507f-bc19-436b-b000-84a10bf85a07 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:26.257408 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-70b0507f-bc19-436b-b000-84a10bf85a07 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: c8419121-12d7-431e-9ff0-dfa04c64cd00] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:26.263639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-70b0507f-bc19-436b-b000-84a10bf85a07 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:26.264090 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-70b0507f-bc19-436b-b000-84a10bf85a07 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:26.264863 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-70b0507f-bc19-436b-b000-84a10bf85a07 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:26.265302 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-70b0507f-bc19-436b-b000-84a10bf85a07 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:26.417078 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-70b0507f-bc19-436b-b000-84a10bf85a07 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:26.425394 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-70b0507f-bc19-436b-b000-84a10bf85a07 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00" status: 200 len: 1367 microversion: 2.1 time: 0.172427 Jun 29 12:38:26.425958 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 281/585] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:26 2022] GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:26.743743 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e339b3f6-32c1-4090-be33-203cccd8e067 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:26.744347 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e339b3f6-32c1-4090-be33-203cccd8e067 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:26.750876 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e339b3f6-32c1-4090-be33-203cccd8e067 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:26.751317 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e339b3f6-32c1-4090-be33-203cccd8e067 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:26.752067 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e339b3f6-32c1-4090-be33-203cccd8e067 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:26.752500 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e339b3f6-32c1-4090-be33-203cccd8e067 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:26.885403 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e339b3f6-32c1-4090-be33-203cccd8e067 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:26.893792 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e339b3f6-32c1-4090-be33-203cccd8e067 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1568 microversion: 2.1 time: 0.153973 Jun 29 12:38:26.894349 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 305/586] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:26 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:27.442196 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3f84268e-6499-4160-be5d-aeb0a69e04b6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:27.442864 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3f84268e-6499-4160-be5d-aeb0a69e04b6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: c8419121-12d7-431e-9ff0-dfa04c64cd00] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:27.449273 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3f84268e-6499-4160-be5d-aeb0a69e04b6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:27.449718 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3f84268e-6499-4160-be5d-aeb0a69e04b6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:27.450541 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3f84268e-6499-4160-be5d-aeb0a69e04b6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:27.450973 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3f84268e-6499-4160-be5d-aeb0a69e04b6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:27.577880 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3f84268e-6499-4160-be5d-aeb0a69e04b6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:27.585356 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3f84268e-6499-4160-be5d-aeb0a69e04b6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00" status: 200 len: 1367 microversion: 2.1 time: 0.147006 Jun 29 12:38:27.586057 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 282/587] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:27 2022] GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:27.910953 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0ec891e5-c7ac-4115-a066-d6d1b63cbd78 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:27.911557 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0ec891e5-c7ac-4115-a066-d6d1b63cbd78 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:27.917433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0ec891e5-c7ac-4115-a066-d6d1b63cbd78 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:27.917878 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0ec891e5-c7ac-4115-a066-d6d1b63cbd78 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:27.918658 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0ec891e5-c7ac-4115-a066-d6d1b63cbd78 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:27.919697 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0ec891e5-c7ac-4115-a066-d6d1b63cbd78 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:28.060665 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0ec891e5-c7ac-4115-a066-d6d1b63cbd78 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:28.068038 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0ec891e5-c7ac-4115-a066-d6d1b63cbd78 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1568 microversion: 2.1 time: 0.160967 Jun 29 12:38:28.068595 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 306/588] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:27 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:28.603272 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-545cbee2-bee8-4c11-8fd0-6f5b4b83930e tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:28.603814 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-545cbee2-bee8-4c11-8fd0-6f5b4b83930e tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: c8419121-12d7-431e-9ff0-dfa04c64cd00] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:28.610983 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-545cbee2-bee8-4c11-8fd0-6f5b4b83930e tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:28.611435 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-545cbee2-bee8-4c11-8fd0-6f5b4b83930e tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:28.612198 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-545cbee2-bee8-4c11-8fd0-6f5b4b83930e tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:28.612641 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-545cbee2-bee8-4c11-8fd0-6f5b4b83930e tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:28.741450 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-545cbee2-bee8-4c11-8fd0-6f5b4b83930e tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:28.749541 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-545cbee2-bee8-4c11-8fd0-6f5b4b83930e tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00" status: 200 len: 1367 microversion: 2.1 time: 0.150168 Jun 29 12:38:28.750109 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 283/589] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:28 2022] GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:29.085372 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ae403297-f7d3-46a6-bf64-34c1b21b8f9d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:29.085986 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ae403297-f7d3-46a6-bf64-34c1b21b8f9d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:29.092197 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ae403297-f7d3-46a6-bf64-34c1b21b8f9d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:29.092641 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ae403297-f7d3-46a6-bf64-34c1b21b8f9d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:29.093395 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ae403297-f7d3-46a6-bf64-34c1b21b8f9d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:29.093831 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ae403297-f7d3-46a6-bf64-34c1b21b8f9d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:29.228095 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ae403297-f7d3-46a6-bf64-34c1b21b8f9d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:29.236302 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ae403297-f7d3-46a6-bf64-34c1b21b8f9d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1568 microversion: 2.1 time: 0.154893 Jun 29 12:38:29.236868 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 307/590] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:29 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:29.766230 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5922f367-cf72-4dde-afc7-eb45229f1e4e tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:29.766885 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5922f367-cf72-4dde-afc7-eb45229f1e4e tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: c8419121-12d7-431e-9ff0-dfa04c64cd00] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:29.773680 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5922f367-cf72-4dde-afc7-eb45229f1e4e tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:29.774062 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5922f367-cf72-4dde-afc7-eb45229f1e4e tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:29.774856 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5922f367-cf72-4dde-afc7-eb45229f1e4e tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:29.775286 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5922f367-cf72-4dde-afc7-eb45229f1e4e tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:29.911307 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5922f367-cf72-4dde-afc7-eb45229f1e4e tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:29.918926 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5922f367-cf72-4dde-afc7-eb45229f1e4e tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00" status: 200 len: 1367 microversion: 2.1 time: 0.157299 Jun 29 12:38:29.919924 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 284/591] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:29 2022] GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:30.027306 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-d745b7a8-c1d2-4404-ad5d-0985f85fc29a req-331e3bb7-ceb1-48a0-947c-28eced91161b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8419121-12d7-431e-9ff0-dfa04c64cd00", "name": "network-vif-plugged", "status": "completed", "tag": "96254a3e-9e71-4d23-acc2-9c889cabe601"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:38:30.036309 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-d745b7a8-c1d2-4404-ad5d-0985f85fc29a req-331e3bb7-ceb1-48a0-947c-28eced91161b service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:30.036847 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-d745b7a8-c1d2-4404-ad5d-0985f85fc29a req-331e3bb7-ceb1-48a0-947c-28eced91161b service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:30.049431 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-d745b7a8-c1d2-4404-ad5d-0985f85fc29a req-331e3bb7-ceb1-48a0-947c-28eced91161b service nova] Creating event network-vif-plugged:96254a3e-9e71-4d23-acc2-9c889cabe601 for instance c8419121-12d7-431e-9ff0-dfa04c64cd00 on hv-cinder-81268 Jun 29 12:38:30.054519 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-d745b7a8-c1d2-4404-ad5d-0985f85fc29a req-331e3bb7-ceb1-48a0-947c-28eced91161b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030953 Jun 29 12:38:30.055111 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 308/592] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:38:30.253782 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e8f5d972-71b8-4e41-ba97-38d310f695cb tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:30.254506 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e8f5d972-71b8-4e41-ba97-38d310f695cb tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:30.260455 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e8f5d972-71b8-4e41-ba97-38d310f695cb tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:30.260945 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e8f5d972-71b8-4e41-ba97-38d310f695cb tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:30.261658 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e8f5d972-71b8-4e41-ba97-38d310f695cb tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:30.262100 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e8f5d972-71b8-4e41-ba97-38d310f695cb tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:30.401954 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e8f5d972-71b8-4e41-ba97-38d310f695cb tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:30.409662 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e8f5d972-71b8-4e41-ba97-38d310f695cb tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1568 microversion: 2.1 time: 0.159767 Jun 29 12:38:30.410227 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 285/593] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:30 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:30.855882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b8469cf0-536b-433e-b426-32627c3f2296 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:30.857081 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b8469cf0-536b-433e-b426-32627c3f2296 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:30.863328 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b8469cf0-536b-433e-b426-32627c3f2296 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:30.863783 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b8469cf0-536b-433e-b426-32627c3f2296 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:30.864544 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b8469cf0-536b-433e-b426-32627c3f2296 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:30.864979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b8469cf0-536b-433e-b426-32627c3f2296 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:30.887057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b8469cf0-536b-433e-b426-32627c3f2296 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/ips" status: 200 len: 147 microversion: 2.1 time: 0.035401 Jun 29 12:38:30.888120 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 309/594] 10.222.0.52 () {58 vars in 1247 bytes} [Wed Jun 29 12:38:30 2022] GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/ips => generated 147 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:38:30.936936 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6459d461-5536-40cc-9490-5bbdb2a930a6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:30.937551 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6459d461-5536-40cc-9490-5bbdb2a930a6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: c8419121-12d7-431e-9ff0-dfa04c64cd00] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:30.944231 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6459d461-5536-40cc-9490-5bbdb2a930a6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:30.944474 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6459d461-5536-40cc-9490-5bbdb2a930a6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:30.945111 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6459d461-5536-40cc-9490-5bbdb2a930a6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:30.945547 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6459d461-5536-40cc-9490-5bbdb2a930a6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:31.164379 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6459d461-5536-40cc-9490-5bbdb2a930a6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:31.173156 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6459d461-5536-40cc-9490-5bbdb2a930a6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00" status: 200 len: 1367 microversion: 2.1 time: 0.240006 Jun 29 12:38:31.183001 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 286/595] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:30 2022] GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:31.426822 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-be7f1171-36cd-4998-9cdd-c91583a65f8c tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:31.427427 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-be7f1171-36cd-4998-9cdd-c91583a65f8c tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:31.433662 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-be7f1171-36cd-4998-9cdd-c91583a65f8c tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:31.434118 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-be7f1171-36cd-4998-9cdd-c91583a65f8c tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:31.435083 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-be7f1171-36cd-4998-9cdd-c91583a65f8c tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:31.435525 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-be7f1171-36cd-4998-9cdd-c91583a65f8c tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:31.574266 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-be7f1171-36cd-4998-9cdd-c91583a65f8c tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:31.582731 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-be7f1171-36cd-4998-9cdd-c91583a65f8c tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1568 microversion: 2.1 time: 0.159693 Jun 29 12:38:31.583300 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 310/596] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:31 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:32.189940 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-733d6965-d674-4635-a4bb-583ed8dd6cd1 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:32.190586 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-733d6965-d674-4635-a4bb-583ed8dd6cd1 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: c8419121-12d7-431e-9ff0-dfa04c64cd00] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:32.192524 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:38:32.193195 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=10 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:38:32.202062 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-733d6965-d674-4635-a4bb-583ed8dd6cd1 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:32.202578 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-733d6965-d674-4635-a4bb-583ed8dd6cd1 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:32.203351 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-733d6965-d674-4635-a4bb-583ed8dd6cd1 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:32.203795 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-733d6965-d674-4635-a4bb-583ed8dd6cd1 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:32.241737 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a691f1b7-607a-4148-8572-0ff23db67a46 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "293bfa32-eb3d-4156-9ec1-2a83cbdd71c9"}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:38:32.242979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a691f1b7-607a-4148-8572-0ff23db67a46 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:32.245026 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:38:32.250836 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a691f1b7-607a-4148-8572-0ff23db67a46 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:32.251376 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a691f1b7-607a-4148-8572-0ff23db67a46 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:32.252260 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a691f1b7-607a-4148-8572-0ff23db67a46 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:32.252762 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a691f1b7-607a-4148-8572-0ff23db67a46 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:32.337202 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-733d6965-d674-4635-a4bb-583ed8dd6cd1 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:32.345540 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-733d6965-d674-4635-a4bb-583ed8dd6cd1 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00" status: 200 len: 1557 microversion: 2.1 time: 0.159363 Jun 29 12:38:32.346114 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 287/597] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:32 2022] GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00 => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:32.361682 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4f1d1b4b-9dce-4e12-8f85-e1b0feea17c3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:32.362180 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4f1d1b4b-9dce-4e12-8f85-e1b0feea17c3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: c8419121-12d7-431e-9ff0-dfa04c64cd00] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:32.368329 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4f1d1b4b-9dce-4e12-8f85-e1b0feea17c3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:32.368779 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4f1d1b4b-9dce-4e12-8f85-e1b0feea17c3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:32.369536 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4f1d1b4b-9dce-4e12-8f85-e1b0feea17c3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:32.369974 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4f1d1b4b-9dce-4e12-8f85-e1b0feea17c3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:32.448061 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4f1d1b4b-9dce-4e12-8f85-e1b0feea17c3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090072 Jun 29 12:38:32.448651 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 288/598] 10.222.0.52 () {58 vars in 1274 bytes} [Wed Jun 29 12:38:32 2022] GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:38:32.600181 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8286e873-41b6-46f1-a81a-ea22a5eb0d0b tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:32.600797 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8286e873-41b6-46f1-a81a-ea22a5eb0d0b tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:32.607071 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8286e873-41b6-46f1-a81a-ea22a5eb0d0b tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:32.607523 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8286e873-41b6-46f1-a81a-ea22a5eb0d0b tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:32.608686 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8286e873-41b6-46f1-a81a-ea22a5eb0d0b tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:32.609134 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8286e873-41b6-46f1-a81a-ea22a5eb0d0b tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:32.904018 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8286e873-41b6-46f1-a81a-ea22a5eb0d0b tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:32.915508 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8286e873-41b6-46f1-a81a-ea22a5eb0d0b tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1568 microversion: 2.1 time: 0.318764 Jun 29 12:38:32.916514 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 289/599] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:32 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1568 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:38:33.221345 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a691f1b7-607a-4148-8572-0ff23db67a46 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "POST /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.983285 Jun 29 12:38:33.221844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 311/600] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Jun 29 12:38:32 2022] POST /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/os-volume_attachments => generated 194 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:38:33.813068 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-8fc0f78c-05e5-4dfb-b2e9-8ce259bb934d req-5565c191-f97b-44b3-95bb-4f9f7cf6ec46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8419121-12d7-431e-9ff0-dfa04c64cd00", "tag": "96254a3e-9e71-4d23-acc2-9c889cabe601"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:38:33.823060 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-8fc0f78c-05e5-4dfb-b2e9-8ce259bb934d req-5565c191-f97b-44b3-95bb-4f9f7cf6ec46 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:33.823502 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-8fc0f78c-05e5-4dfb-b2e9-8ce259bb934d req-5565c191-f97b-44b3-95bb-4f9f7cf6ec46 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:33.841067 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-8fc0f78c-05e5-4dfb-b2e9-8ce259bb934d req-5565c191-f97b-44b3-95bb-4f9f7cf6ec46 service nova] Creating event network-changed:96254a3e-9e71-4d23-acc2-9c889cabe601 for instance c8419121-12d7-431e-9ff0-dfa04c64cd00 on hv-cinder-81268 Jun 29 12:38:33.846907 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-8fc0f78c-05e5-4dfb-b2e9-8ce259bb934d req-5565c191-f97b-44b3-95bb-4f9f7cf6ec46 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037677 Jun 29 12:38:33.847920 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 290/601] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:38:33.853324 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 12:38:33.853800 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Wed Jun 29 12:38:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 12:38:33.934089 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-74c9bf15-9f3e-48bc-be25-25a6a6b1884a tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:33.934876 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-74c9bf15-9f3e-48bc-be25-25a6a6b1884a tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:33.942337 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-74c9bf15-9f3e-48bc-be25-25a6a6b1884a tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:33.942826 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-74c9bf15-9f3e-48bc-be25-25a6a6b1884a tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:33.943605 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-74c9bf15-9f3e-48bc-be25-25a6a6b1884a tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:33.944047 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-74c9bf15-9f3e-48bc-be25-25a6a6b1884a tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:34.077536 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-74c9bf15-9f3e-48bc-be25-25a6a6b1884a tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:34.085139 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-74c9bf15-9f3e-48bc-be25-25a6a6b1884a tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1569 microversion: 2.1 time: 0.155818 Jun 29 12:38:34.085791 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 312/602] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:33 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:34.102544 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-340bcee5-fd99-45db-978f-8627660cd6e8 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:38:34.103202 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-340bcee5-fd99-45db-978f-8627660cd6e8 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:34.109909 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-340bcee5-fd99-45db-978f-8627660cd6e8 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:34.110544 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-340bcee5-fd99-45db-978f-8627660cd6e8 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:34.111460 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-340bcee5-fd99-45db-978f-8627660cd6e8 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:34.111986 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-340bcee5-fd99-45db-978f-8627660cd6e8 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:34.201305 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-340bcee5-fd99-45db-978f-8627660cd6e8 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "POST /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784/action" status: 202 len: 0 microversion: 2.1 time: 0.102731 Jun 29 12:38:34.202201 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 291/603] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 12:38:34 2022] POST /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:38:34.210373 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e8780955-7ff7-4876-bac8-5d99b903cae6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:34.211007 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e8780955-7ff7-4876-bac8-5d99b903cae6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:34.219457 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e8780955-7ff7-4876-bac8-5d99b903cae6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:34.219913 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e8780955-7ff7-4876-bac8-5d99b903cae6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:34.220867 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e8780955-7ff7-4876-bac8-5d99b903cae6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:34.221471 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e8780955-7ff7-4876-bac8-5d99b903cae6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:34.227628 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:38:34.438797 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e8780955-7ff7-4876-bac8-5d99b903cae6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:34.446553 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e8780955-7ff7-4876-bac8-5d99b903cae6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1577 microversion: 2.1 time: 0.239954 Jun 29 12:38:34.447287 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 313/604] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:34 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1577 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:35.464296 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2e6b3df6-25d2-4b6b-9656-93da0b56a4d7 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:35.464915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2e6b3df6-25d2-4b6b-9656-93da0b56a4d7 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:35.471486 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2e6b3df6-25d2-4b6b-9656-93da0b56a4d7 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:35.471939 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2e6b3df6-25d2-4b6b-9656-93da0b56a4d7 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:35.472780 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2e6b3df6-25d2-4b6b-9656-93da0b56a4d7 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:35.473275 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2e6b3df6-25d2-4b6b-9656-93da0b56a4d7 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:35.611317 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2e6b3df6-25d2-4b6b-9656-93da0b56a4d7 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:35.618746 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2e6b3df6-25d2-4b6b-9656-93da0b56a4d7 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1519 microversion: 2.1 time: 0.158771 Jun 29 12:38:35.619298 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 292/605] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:35 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:36.004542 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-8d19e79a-90bf-45b9-bfc4-5ba108c95f5d req-3cd933df-a382-4e37-ab9d-842b7e6f26f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72186d8a-10a4-4b4a-b57e-6e8e520dc784", "name": "network-vif-unplugged", "status": "completed", "tag": "32283955-f720-4723-80b6-82d0fc44730d"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:38:36.015166 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-8d19e79a-90bf-45b9-bfc4-5ba108c95f5d req-3cd933df-a382-4e37-ab9d-842b7e6f26f1 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:36.015611 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-8d19e79a-90bf-45b9-bfc4-5ba108c95f5d req-3cd933df-a382-4e37-ab9d-842b7e6f26f1 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:36.027094 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.compute.server_external_events [req-8d19e79a-90bf-45b9-bfc4-5ba108c95f5d req-3cd933df-a382-4e37-ab9d-842b7e6f26f1 service nova] Unable to find a host for instance 72186d8a-10a4-4b4a-b57e-6e8e520dc784. Dropping event network-vif-unplugged {{(pid=124317) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 29 12:38:36.028761 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-8d19e79a-90bf-45b9-bfc4-5ba108c95f5d req-3cd933df-a382-4e37-ab9d-842b7e6f26f1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027456 Jun 29 12:38:36.029736 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 314/606] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 29 12:38:36.636405 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-bb8564f0-7aa3-4111-a44c-bf04e0397781 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:36.637014 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-bb8564f0-7aa3-4111-a44c-bf04e0397781 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:36.645076 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bb8564f0-7aa3-4111-a44c-bf04e0397781 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:36.645780 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bb8564f0-7aa3-4111-a44c-bf04e0397781 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:36.646568 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bb8564f0-7aa3-4111-a44c-bf04e0397781 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:36.647007 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bb8564f0-7aa3-4111-a44c-bf04e0397781 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:36.777021 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-bb8564f0-7aa3-4111-a44c-bf04e0397781 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:36.781159 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:38:36.786097 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-bb8564f0-7aa3-4111-a44c-bf04e0397781 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1519 microversion: 2.1 time: 0.153468 Jun 29 12:38:36.786687 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 293/607] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:36 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:37.803837 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-fad91c34-753e-4c4e-90c4-304da6531808 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:37.804464 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-fad91c34-753e-4c4e-90c4-304da6531808 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:37.811586 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fad91c34-753e-4c4e-90c4-304da6531808 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:37.812025 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fad91c34-753e-4c4e-90c4-304da6531808 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:37.812775 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fad91c34-753e-4c4e-90c4-304da6531808 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:37.813203 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fad91c34-753e-4c4e-90c4-304da6531808 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:37.945249 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-fad91c34-753e-4c4e-90c4-304da6531808 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:37.952673 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-fad91c34-753e-4c4e-90c4-304da6531808 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1519 microversion: 2.1 time: 0.152680 Jun 29 12:38:37.953272 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 315/608] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:37 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:38.969864 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9a536ba9-faa2-40be-b0d0-689afa15789d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:38.970496 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-9a536ba9-faa2-40be-b0d0-689afa15789d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:38.977976 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9a536ba9-faa2-40be-b0d0-689afa15789d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:38.978456 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9a536ba9-faa2-40be-b0d0-689afa15789d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:38.979204 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9a536ba9-faa2-40be-b0d0-689afa15789d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:38.979644 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9a536ba9-faa2-40be-b0d0-689afa15789d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:39.117690 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9a536ba9-faa2-40be-b0d0-689afa15789d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:39.125789 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9a536ba9-faa2-40be-b0d0-689afa15789d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1519 microversion: 2.1 time: 0.159911 Jun 29 12:38:39.126377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 294/609] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:38 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:39.846111 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-fb84f0e6-397b-4bea-b98e-bdfea2b580fd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:39.847210 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-fb84f0e6-397b-4bea-b98e-bdfea2b580fd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:39.853562 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fb84f0e6-397b-4bea-b98e-bdfea2b580fd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:39.854008 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fb84f0e6-397b-4bea-b98e-bdfea2b580fd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:39.854820 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fb84f0e6-397b-4bea-b98e-bdfea2b580fd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:39.855253 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fb84f0e6-397b-4bea-b98e-bdfea2b580fd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:39.886115 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-fb84f0e6-397b-4bea-b98e-bdfea2b580fd tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045008 Jun 29 12:38:39.886698 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 316/610] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 12:38:39 2022] GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:38:39.897813 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2f0ea6aa-a9f4-4691-9195-9e88cd641c5a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:39.898317 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2f0ea6aa-a9f4-4691-9195-9e88cd641c5a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:39.905321 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2f0ea6aa-a9f4-4691-9195-9e88cd641c5a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:39.905761 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2f0ea6aa-a9f4-4691-9195-9e88cd641c5a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:39.906798 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2f0ea6aa-a9f4-4691-9195-9e88cd641c5a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:39.907144 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2f0ea6aa-a9f4-4691-9195-9e88cd641c5a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:39.936810 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2f0ea6aa-a9f4-4691-9195-9e88cd641c5a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/os-volume_attachments/293bfa32-eb3d-4156-9ec1-2a83cbdd71c9" status: 200 len: 194 microversion: 2.1 time: 0.043327 Jun 29 12:38:39.937659 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 295/611] 10.222.0.52 () {58 vars in 1412 bytes} [Wed Jun 29 12:38:39 2022] GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/os-volume_attachments/293bfa32-eb3d-4156-9ec1-2a83cbdd71c9 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:38:40.143114 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f282b82c-eb96-47af-83ca-894c792a4bd2 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:40.143953 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f282b82c-eb96-47af-83ca-894c792a4bd2 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:40.150043 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f282b82c-eb96-47af-83ca-894c792a4bd2 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:40.150522 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f282b82c-eb96-47af-83ca-894c792a4bd2 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:40.151283 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f282b82c-eb96-47af-83ca-894c792a4bd2 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:40.151720 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f282b82c-eb96-47af-83ca-894c792a4bd2 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:40.306571 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f282b82c-eb96-47af-83ca-894c792a4bd2 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:40.315008 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f282b82c-eb96-47af-83ca-894c792a4bd2 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1575 microversion: 2.1 time: 0.175647 Jun 29 12:38:40.315573 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 317/612] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:40 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:41.277407 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b3d8c791-bbc8-413d-ad76-9e3f8e41f1b8 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9bf1fd29-62b7-4582-8ceb-5dcc03c04932"}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:38:41.279582 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b3d8c791-bbc8-413d-ad76-9e3f8e41f1b8 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:41.286037 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b3d8c791-bbc8-413d-ad76-9e3f8e41f1b8 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:41.286519 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b3d8c791-bbc8-413d-ad76-9e3f8e41f1b8 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:41.287274 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b3d8c791-bbc8-413d-ad76-9e3f8e41f1b8 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:41.287713 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b3d8c791-bbc8-413d-ad76-9e3f8e41f1b8 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:41.331553 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-dae379c6-f330-42fe-832e-4da2afdb7724 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:41.332158 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-dae379c6-f330-42fe-832e-4da2afdb7724 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:41.338555 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dae379c6-f330-42fe-832e-4da2afdb7724 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:41.339002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dae379c6-f330-42fe-832e-4da2afdb7724 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:41.339744 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dae379c6-f330-42fe-832e-4da2afdb7724 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:41.340181 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dae379c6-f330-42fe-832e-4da2afdb7724 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:41.480290 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-dae379c6-f330-42fe-832e-4da2afdb7724 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:41.488080 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-dae379c6-f330-42fe-832e-4da2afdb7724 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1575 microversion: 2.1 time: 0.160249 Jun 29 12:38:41.488650 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 318/613] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:41 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:38:41.531770 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b3d8c791-bbc8-413d-ad76-9e3f8e41f1b8 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "POST /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257970 Jun 29 12:38:41.532468 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 296/614] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Jun 29 12:38:41 2022] POST /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:38:42.505028 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-417d1e17-6e0a-460d-adce-07e9da466c6d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:42.505628 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-417d1e17-6e0a-460d-adce-07e9da466c6d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:42.512082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-417d1e17-6e0a-460d-adce-07e9da466c6d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:42.512520 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-417d1e17-6e0a-460d-adce-07e9da466c6d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:42.513264 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-417d1e17-6e0a-460d-adce-07e9da466c6d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:42.514373 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-417d1e17-6e0a-460d-adce-07e9da466c6d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:42.654095 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-417d1e17-6e0a-460d-adce-07e9da466c6d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:42.661829 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-417d1e17-6e0a-460d-adce-07e9da466c6d tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1575 microversion: 2.1 time: 0.160606 Jun 29 12:38:42.662399 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 319/615] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:42 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:43.681282 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-45545626-9838-48ee-9180-cb10f8a00dce tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:43.681970 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-45545626-9838-48ee-9180-cb10f8a00dce tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:43.688199 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-45545626-9838-48ee-9180-cb10f8a00dce tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:43.688685 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-45545626-9838-48ee-9180-cb10f8a00dce tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:43.689386 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-45545626-9838-48ee-9180-cb10f8a00dce tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:43.689814 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-45545626-9838-48ee-9180-cb10f8a00dce tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:43.820848 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-45545626-9838-48ee-9180-cb10f8a00dce tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:43.828807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-45545626-9838-48ee-9180-cb10f8a00dce tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1575 microversion: 2.1 time: 0.153008 Jun 29 12:38:43.829363 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 297/616] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:43 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:44.846260 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-84cafd8d-f9b7-4db4-ae23-295d3ae5fe77 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:44.846892 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-84cafd8d-f9b7-4db4-ae23-295d3ae5fe77 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:44.853546 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-84cafd8d-f9b7-4db4-ae23-295d3ae5fe77 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:44.853982 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-84cafd8d-f9b7-4db4-ae23-295d3ae5fe77 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:44.854756 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-84cafd8d-f9b7-4db4-ae23-295d3ae5fe77 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:44.855185 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-84cafd8d-f9b7-4db4-ae23-295d3ae5fe77 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:44.993104 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-84cafd8d-f9b7-4db4-ae23-295d3ae5fe77 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:45.000915 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-84cafd8d-f9b7-4db4-ae23-295d3ae5fe77 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1575 microversion: 2.1 time: 0.159499 Jun 29 12:38:45.001476 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 320/617] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:44 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:45.172381 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5223591e-d09f-466a-acbb-a86e71d83a83 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:45.172884 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5223591e-d09f-466a-acbb-a86e71d83a83 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:45.178878 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5223591e-d09f-466a-acbb-a86e71d83a83 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:45.179321 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5223591e-d09f-466a-acbb-a86e71d83a83 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:45.180078 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5223591e-d09f-466a-acbb-a86e71d83a83 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:45.180515 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5223591e-d09f-466a-acbb-a86e71d83a83 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:45.204898 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5223591e-d09f-466a-acbb-a86e71d83a83 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db/ips" status: 200 len: 151 microversion: 2.20 time: 0.145710 Jun 29 12:38:45.205448 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 298/618] 10.222.0.52 () {60 vars in 1288 bytes} [Wed Jun 29 12:38:45 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db/ips => generated 151 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 12:38:46.017704 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-fd242102-7c3e-40b8-9c55-e62ace0c420b tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:46.018273 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-fd242102-7c3e-40b8-9c55-e62ace0c420b tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:46.025002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fd242102-7c3e-40b8-9c55-e62ace0c420b tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:46.025452 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fd242102-7c3e-40b8-9c55-e62ace0c420b tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:46.026219 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fd242102-7c3e-40b8-9c55-e62ace0c420b tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:46.026688 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-fd242102-7c3e-40b8-9c55-e62ace0c420b tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:46.161873 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-fd242102-7c3e-40b8-9c55-e62ace0c420b tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:46.169459 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-fd242102-7c3e-40b8-9c55-e62ace0c420b tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1575 microversion: 2.1 time: 0.156103 Jun 29 12:38:46.170694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 321/619] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:46 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:47.018272 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-67925ff2-c1e1-48ad-889b-db34ca2834e5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:38:47.018840 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-67925ff2-c1e1-48ad-889b-db34ca2834e5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:47.025513 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-67925ff2-c1e1-48ad-889b-db34ca2834e5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:47.025961 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-67925ff2-c1e1-48ad-889b-db34ca2834e5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:47.026745 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-67925ff2-c1e1-48ad-889b-db34ca2834e5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:47.027183 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-67925ff2-c1e1-48ad-889b-db34ca2834e5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:47.050709 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-67925ff2-c1e1-48ad-889b-db34ca2834e5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lazy-loading 'flavor' on Instance uuid b6005eeb-de9c-4299-85da-6bf176fba2db {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 12:38:47.187793 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9d96107f-19f3-44be-be86-088ea4df0c31 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:47.188407 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-9d96107f-19f3-44be-be86-088ea4df0c31 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:47.195542 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9d96107f-19f3-44be-be86-088ea4df0c31 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:47.195993 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9d96107f-19f3-44be-be86-088ea4df0c31 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:47.196757 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9d96107f-19f3-44be-be86-088ea4df0c31 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:47.197199 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9d96107f-19f3-44be-be86-088ea4df0c31 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:47.310503 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-67925ff2-c1e1-48ad-889b-db34ca2834e5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "POST /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db/action" status: 202 len: 0 microversion: 2.20 time: 0.295901 Jun 29 12:38:47.312084 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 299/620] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Jun 29 12:38:47 2022] POST /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 29 12:38:47.321277 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-14e4a8d4-1484-46ff-b18d-a6b434657d3a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:47.322224 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-14e4a8d4-1484-46ff-b18d-a6b434657d3a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:47.330489 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-14e4a8d4-1484-46ff-b18d-a6b434657d3a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:47.330939 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-14e4a8d4-1484-46ff-b18d-a6b434657d3a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:47.331702 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-14e4a8d4-1484-46ff-b18d-a6b434657d3a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:47.332134 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-14e4a8d4-1484-46ff-b18d-a6b434657d3a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:47.336342 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-9d96107f-19f3-44be-be86-088ea4df0c31 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:47.348340 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-9d96107f-19f3-44be-be86-088ea4df0c31 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1575 microversion: 2.1 time: 0.161044 Jun 29 12:38:47.348340 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 322/621] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:47 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:38:47.495099 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-14e4a8d4-1484-46ff-b18d-a6b434657d3a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:47.503479 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-14e4a8d4-1484-46ff-b18d-a6b434657d3a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:47.504973 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-14e4a8d4-1484-46ff-b18d-a6b434657d3a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:47.506131 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-14e4a8d4-1484-46ff-b18d-a6b434657d3a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1723 microversion: 2.20 time: 0.189902 Jun 29 12:38:47.506726 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 300/622] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:38:47 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:38:48.361234 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1db5dcce-42a8-41ce-8943-8c40e321dca6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:48.361862 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1db5dcce-42a8-41ce-8943-8c40e321dca6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:48.368397 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1db5dcce-42a8-41ce-8943-8c40e321dca6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:48.368838 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1db5dcce-42a8-41ce-8943-8c40e321dca6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:48.369611 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1db5dcce-42a8-41ce-8943-8c40e321dca6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:48.370038 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1db5dcce-42a8-41ce-8943-8c40e321dca6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:48.503833 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1db5dcce-42a8-41ce-8943-8c40e321dca6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:48.511581 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1db5dcce-42a8-41ce-8943-8c40e321dca6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1575 microversion: 2.1 time: 0.154452 Jun 29 12:38:48.512145 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 323/623] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:48 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:48.525399 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0dcaaca3-6b23-489e-89bd-b4a8b4f4074a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:48.526143 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0dcaaca3-6b23-489e-89bd-b4a8b4f4074a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:48.532831 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0dcaaca3-6b23-489e-89bd-b4a8b4f4074a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:48.533378 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0dcaaca3-6b23-489e-89bd-b4a8b4f4074a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:48.534119 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0dcaaca3-6b23-489e-89bd-b4a8b4f4074a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:48.534589 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0dcaaca3-6b23-489e-89bd-b4a8b4f4074a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:48.667836 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0dcaaca3-6b23-489e-89bd-b4a8b4f4074a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:48.676218 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0dcaaca3-6b23-489e-89bd-b4a8b4f4074a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:48.677709 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0dcaaca3-6b23-489e-89bd-b4a8b4f4074a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:48.678884 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0dcaaca3-6b23-489e-89bd-b4a8b4f4074a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1723 microversion: 2.20 time: 0.157353 Jun 29 12:38:48.679433 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 301/624] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:38:48 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:38:49.040155 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-556e835f-4699-4010-9cf8-b664846189ea tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:49.041082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-556e835f-4699-4010-9cf8-b664846189ea tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:49.047682 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-556e835f-4699-4010-9cf8-b664846189ea tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:49.048132 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-556e835f-4699-4010-9cf8-b664846189ea tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:49.048897 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-556e835f-4699-4010-9cf8-b664846189ea tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:49.049340 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-556e835f-4699-4010-9cf8-b664846189ea tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:49.079095 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-556e835f-4699-4010-9cf8-b664846189ea tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042804 Jun 29 12:38:49.079667 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 324/625] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 12:38:49 2022] GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:38:49.219565 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-750893d5-2e8d-4fcf-9a8b-6a2670d5523f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:49.219974 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-750893d5-2e8d-4fcf-9a8b-6a2670d5523f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:49.221984 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:38:49.227495 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-750893d5-2e8d-4fcf-9a8b-6a2670d5523f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:49.227947 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-750893d5-2e8d-4fcf-9a8b-6a2670d5523f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:49.228708 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-750893d5-2e8d-4fcf-9a8b-6a2670d5523f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:49.229145 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-750893d5-2e8d-4fcf-9a8b-6a2670d5523f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:49.258891 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-750893d5-2e8d-4fcf-9a8b-6a2670d5523f tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/os-volume_attachments/293bfa32-eb3d-4156-9ec1-2a83cbdd71c9" status: 200 len: 194 microversion: 2.1 time: 0.044003 Jun 29 12:38:49.259473 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 302/626] 10.222.0.52 () {58 vars in 1412 bytes} [Wed Jun 29 12:38:49 2022] GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/os-volume_attachments/293bfa32-eb3d-4156-9ec1-2a83cbdd71c9 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:38:49.269601 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b6fb0cad-5f0c-4a19-bbdd-b61c11ae420b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:49.270094 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b6fb0cad-5f0c-4a19-bbdd-b61c11ae420b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:49.276340 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b6fb0cad-5f0c-4a19-bbdd-b61c11ae420b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:49.276784 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b6fb0cad-5f0c-4a19-bbdd-b61c11ae420b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:49.277541 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b6fb0cad-5f0c-4a19-bbdd-b61c11ae420b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:49.277977 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b6fb0cad-5f0c-4a19-bbdd-b61c11ae420b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:49.357298 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-b6fb0cad-5f0c-4a19-bbdd-b61c11ae420b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lazy-loading 'services' on Instance uuid 32214b00-153f-4be8-a43b-7babcb3c0ece {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 12:38:49.427947 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b6fb0cad-5f0c-4a19-bbdd-b61c11ae420b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "DELETE /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/os-volume_attachments/293bfa32-eb3d-4156-9ec1-2a83cbdd71c9" status: 202 len: 0 microversion: 2.1 time: 0.162139 Jun 29 12:38:49.428676 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 325/627] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 12:38:49 2022] DELETE /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/os-volume_attachments/293bfa32-eb3d-4156-9ec1-2a83cbdd71c9 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:38:49.529554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6d658758-23f5-43f0-8e57-cbc206022743 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:49.530157 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6d658758-23f5-43f0-8e57-cbc206022743 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:49.536576 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6d658758-23f5-43f0-8e57-cbc206022743 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:49.537026 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6d658758-23f5-43f0-8e57-cbc206022743 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:49.537779 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6d658758-23f5-43f0-8e57-cbc206022743 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:49.538208 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6d658758-23f5-43f0-8e57-cbc206022743 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:49.666316 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6d658758-23f5-43f0-8e57-cbc206022743 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:49.674224 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6d658758-23f5-43f0-8e57-cbc206022743 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1575 microversion: 2.1 time: 0.148668 Jun 29 12:38:49.674807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 303/628] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:49 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:49.697457 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e3ea9cc1-0711-41b3-8a61-e6b4c51623ef tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:49.698151 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e3ea9cc1-0711-41b3-8a61-e6b4c51623ef tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:49.704473 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e3ea9cc1-0711-41b3-8a61-e6b4c51623ef tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:49.704937 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e3ea9cc1-0711-41b3-8a61-e6b4c51623ef tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:49.705684 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e3ea9cc1-0711-41b3-8a61-e6b4c51623ef tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:49.706114 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e3ea9cc1-0711-41b3-8a61-e6b4c51623ef tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:49.838559 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e3ea9cc1-0711-41b3-8a61-e6b4c51623ef tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:49.847074 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e3ea9cc1-0711-41b3-8a61-e6b4c51623ef tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:49.848577 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e3ea9cc1-0711-41b3-8a61-e6b4c51623ef tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:49.849736 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e3ea9cc1-0711-41b3-8a61-e6b4c51623ef tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1723 microversion: 2.20 time: 0.156467 Jun 29 12:38:49.850506 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 326/629] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:38:49 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:38:50.108004 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-1fca3d1b-5e14-4fef-9f79-253770111bea req-95fe2e7c-5124-468c-bf47-f1ca2f25ea2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72186d8a-10a4-4b4a-b57e-6e8e520dc784", "name": "network-vif-plugged", "status": "completed", "tag": "32283955-f720-4723-80b6-82d0fc44730d"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:38:50.117046 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-1fca3d1b-5e14-4fef-9f79-253770111bea req-95fe2e7c-5124-468c-bf47-f1ca2f25ea2b service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:50.117498 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-1fca3d1b-5e14-4fef-9f79-253770111bea req-95fe2e7c-5124-468c-bf47-f1ca2f25ea2b service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:50.128746 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-1fca3d1b-5e14-4fef-9f79-253770111bea req-95fe2e7c-5124-468c-bf47-f1ca2f25ea2b service nova] Creating event network-vif-plugged:32283955-f720-4723-80b6-82d0fc44730d for instance 72186d8a-10a4-4b4a-b57e-6e8e520dc784 on hv-cinder-81268 Jun 29 12:38:50.133563 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-1fca3d1b-5e14-4fef-9f79-253770111bea req-95fe2e7c-5124-468c-bf47-f1ca2f25ea2b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029242 Jun 29 12:38:50.134157 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 304/630] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:38:50.542649 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-7ab50269-8428-499f-a0f1-41abfabc79aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:50.543167 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-7ab50269-8428-499f-a0f1-41abfabc79aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:50.545592 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=61 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:38:50.551586 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7ab50269-8428-499f-a0f1-41abfabc79aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:50.552029 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7ab50269-8428-499f-a0f1-41abfabc79aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:50.552784 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7ab50269-8428-499f-a0f1-41abfabc79aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:50.553210 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7ab50269-8428-499f-a0f1-41abfabc79aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:50.581395 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-7ab50269-8428-499f-a0f1-41abfabc79aa tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/os-volume_attachments/9bf1fd29-62b7-4582-8ceb-5dcc03c04932" status: 200 len: 194 microversion: 2.1 time: 0.042700 Jun 29 12:38:50.581989 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 327/631] 10.222.0.52 () {58 vars in 1412 bytes} [Wed Jun 29 12:38:50 2022] GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/os-volume_attachments/9bf1fd29-62b7-4582-8ceb-5dcc03c04932 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:38:50.592609 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-81690bd1-6c24-442d-913f-b1935c22a0d4 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:50.593192 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-81690bd1-6c24-442d-913f-b1935c22a0d4 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:50.599975 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-81690bd1-6c24-442d-913f-b1935c22a0d4 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:50.600422 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-81690bd1-6c24-442d-913f-b1935c22a0d4 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:50.601177 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-81690bd1-6c24-442d-913f-b1935c22a0d4 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:50.601613 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-81690bd1-6c24-442d-913f-b1935c22a0d4 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:50.681007 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-81690bd1-6c24-442d-913f-b1935c22a0d4 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lazy-loading 'services' on Instance uuid 32214b00-153f-4be8-a43b-7babcb3c0ece {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 12:38:50.691504 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d308a93f-e7b7-4b61-a735-5256f2ffdc44 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:50.692215 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d308a93f-e7b7-4b61-a735-5256f2ffdc44 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:50.698087 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d308a93f-e7b7-4b61-a735-5256f2ffdc44 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:50.698573 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d308a93f-e7b7-4b61-a735-5256f2ffdc44 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:50.699321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d308a93f-e7b7-4b61-a735-5256f2ffdc44 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:50.699925 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d308a93f-e7b7-4b61-a735-5256f2ffdc44 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:50.756370 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-81690bd1-6c24-442d-913f-b1935c22a0d4 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "DELETE /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/os-volume_attachments/9bf1fd29-62b7-4582-8ceb-5dcc03c04932" status: 202 len: 0 microversion: 2.1 time: 0.168250 Jun 29 12:38:50.756939 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 305/632] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 12:38:50 2022] DELETE /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/os-volume_attachments/9bf1fd29-62b7-4582-8ceb-5dcc03c04932 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:38:50.852240 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d308a93f-e7b7-4b61-a735-5256f2ffdc44 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:50.859988 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d308a93f-e7b7-4b61-a735-5256f2ffdc44 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1575 microversion: 2.1 time: 0.172860 Jun 29 12:38:50.861369 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 328/633] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:50 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:38:50.869940 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f3862d30-5c11-42e3-9b02-e1cba4fd7618 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:50.870684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f3862d30-5c11-42e3-9b02-e1cba4fd7618 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:50.877690 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f3862d30-5c11-42e3-9b02-e1cba4fd7618 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:50.878136 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f3862d30-5c11-42e3-9b02-e1cba4fd7618 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:50.878912 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f3862d30-5c11-42e3-9b02-e1cba4fd7618 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:50.879344 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f3862d30-5c11-42e3-9b02-e1cba4fd7618 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:51.009948 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f3862d30-5c11-42e3-9b02-e1cba4fd7618 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:51.018267 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f3862d30-5c11-42e3-9b02-e1cba4fd7618 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:51.019880 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f3862d30-5c11-42e3-9b02-e1cba4fd7618 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:51.021330 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f3862d30-5c11-42e3-9b02-e1cba4fd7618 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1723 microversion: 2.20 time: 0.156128 Jun 29 12:38:51.021893 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 306/634] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:38:50 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:38:51.878310 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-66a053b2-2523-4b44-8298-3fd190b93bd6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:51.878947 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-66a053b2-2523-4b44-8298-3fd190b93bd6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:51.885899 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-66a053b2-2523-4b44-8298-3fd190b93bd6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:51.886339 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-66a053b2-2523-4b44-8298-3fd190b93bd6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:51.887130 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-66a053b2-2523-4b44-8298-3fd190b93bd6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:51.887562 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-66a053b2-2523-4b44-8298-3fd190b93bd6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:52.030919 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-66a053b2-2523-4b44-8298-3fd190b93bd6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:52.035837 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:38:52.041529 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-66a053b2-2523-4b44-8298-3fd190b93bd6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1575 microversion: 2.1 time: 0.167120 Jun 29 12:38:52.042103 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 329/635] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:51 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:52.042329 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3e37faf4-a464-4d3e-9af8-65c80192b37f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:52.045700 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3e37faf4-a464-4d3e-9af8-65c80192b37f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:52.059427 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3e37faf4-a464-4d3e-9af8-65c80192b37f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:52.059877 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3e37faf4-a464-4d3e-9af8-65c80192b37f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:52.060654 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3e37faf4-a464-4d3e-9af8-65c80192b37f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:52.061085 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3e37faf4-a464-4d3e-9af8-65c80192b37f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:52.082240 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:38:52.088956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-897f7897-0296-4f90-b142-921f7594b6ac tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:52.089954 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-897f7897-0296-4f90-b142-921f7594b6ac tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:52.097766 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-897f7897-0296-4f90-b142-921f7594b6ac tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:52.098282 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-897f7897-0296-4f90-b142-921f7594b6ac tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:52.099256 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-897f7897-0296-4f90-b142-921f7594b6ac tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:52.099689 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-897f7897-0296-4f90-b142-921f7594b6ac tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:52.129971 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-897f7897-0296-4f90-b142-921f7594b6ac tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045199 Jun 29 12:38:52.130818 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 330/636] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 12:38:52 2022] GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:38:52.207410 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3e37faf4-a464-4d3e-9af8-65c80192b37f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:52.217949 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3e37faf4-a464-4d3e-9af8-65c80192b37f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:52.219646 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3e37faf4-a464-4d3e-9af8-65c80192b37f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:52.220813 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3e37faf4-a464-4d3e-9af8-65c80192b37f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1723 microversion: 2.20 time: 0.185112 Jun 29 12:38:52.221656 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 307/637] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:38:52 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:38:53.059032 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-335bf606-c095-4aa4-94da-bdae04e5fb7e tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:53.059638 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-335bf606-c095-4aa4-94da-bdae04e5fb7e tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:53.066185 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-335bf606-c095-4aa4-94da-bdae04e5fb7e tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:53.066664 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-335bf606-c095-4aa4-94da-bdae04e5fb7e tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:53.067415 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-335bf606-c095-4aa4-94da-bdae04e5fb7e tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:53.067842 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-335bf606-c095-4aa4-94da-bdae04e5fb7e tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:53.141119 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d23b1a37-d40f-4420-9b5f-6bcece158199 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:53.142514 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d23b1a37-d40f-4420-9b5f-6bcece158199 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:53.149525 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d23b1a37-d40f-4420-9b5f-6bcece158199 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:53.149973 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d23b1a37-d40f-4420-9b5f-6bcece158199 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:53.150762 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d23b1a37-d40f-4420-9b5f-6bcece158199 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:53.151196 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d23b1a37-d40f-4420-9b5f-6bcece158199 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:53.183499 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d23b1a37-d40f-4420-9b5f-6bcece158199 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046220 Jun 29 12:38:53.184246 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 308/638] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 12:38:53 2022] GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 29 12:38:53.203659 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-335bf606-c095-4aa4-94da-bdae04e5fb7e tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:53.211497 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-335bf606-c095-4aa4-94da-bdae04e5fb7e tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1562 microversion: 2.1 time: 0.156274 Jun 29 12:38:53.212073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 331/639] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:53 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:53.240365 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d8159ac4-c9cb-419f-934a-1ea24cdf4f8b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:53.241066 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d8159ac4-c9cb-419f-934a-1ea24cdf4f8b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:53.248876 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d8159ac4-c9cb-419f-934a-1ea24cdf4f8b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:53.249384 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d8159ac4-c9cb-419f-934a-1ea24cdf4f8b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:53.250298 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d8159ac4-c9cb-419f-934a-1ea24cdf4f8b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:53.251054 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d8159ac4-c9cb-419f-934a-1ea24cdf4f8b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:53.290585 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-802839e3-2ff7-4340-b34f-206ae0541e62 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:53.291537 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-802839e3-2ff7-4340-b34f-206ae0541e62 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:53.297488 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-802839e3-2ff7-4340-b34f-206ae0541e62 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:53.298283 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-802839e3-2ff7-4340-b34f-206ae0541e62 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:53.298771 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-802839e3-2ff7-4340-b34f-206ae0541e62 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:53.299211 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-802839e3-2ff7-4340-b34f-206ae0541e62 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:53.327111 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-802839e3-2ff7-4340-b34f-206ae0541e62 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040288 Jun 29 12:38:53.327587 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 332/640] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 12:38:53 2022] GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 29 12:38:53.386616 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d8159ac4-c9cb-419f-934a-1ea24cdf4f8b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:53.389574 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b281da17-4257-443e-94b1-725db358ecac tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:53.390076 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b281da17-4257-443e-94b1-725db358ecac tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:53.395772 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d8159ac4-c9cb-419f-934a-1ea24cdf4f8b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:53.396859 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b281da17-4257-443e-94b1-725db358ecac tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:53.397276 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d8159ac4-c9cb-419f-934a-1ea24cdf4f8b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:53.397400 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b281da17-4257-443e-94b1-725db358ecac tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:53.398059 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b281da17-4257-443e-94b1-725db358ecac tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:53.398439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d8159ac4-c9cb-419f-934a-1ea24cdf4f8b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1723 microversion: 2.20 time: 0.163167 Jun 29 12:38:53.398562 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b281da17-4257-443e-94b1-725db358ecac tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:53.398989 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 309/641] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:38:53 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:38:53.423371 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b281da17-4257-443e-94b1-725db358ecac tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Going to try to terminate instance {{(pid=124317) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 12:38:53.496090 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b281da17-4257-443e-94b1-725db358ecac tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "DELETE /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece" status: 204 len: 0 microversion: 2.1 time: 0.110031 Jun 29 12:38:53.496677 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 333/642] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:38:53 2022] DELETE /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 29 12:38:53.505153 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5c2a18e5-615a-4080-a47b-074b3a62366e tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:53.505784 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5c2a18e5-615a-4080-a47b-074b3a62366e tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:53.511851 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5c2a18e5-615a-4080-a47b-074b3a62366e tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:53.512297 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5c2a18e5-615a-4080-a47b-074b3a62366e tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:53.513045 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5c2a18e5-615a-4080-a47b-074b3a62366e tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:53.513472 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5c2a18e5-615a-4080-a47b-074b3a62366e tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:53.640037 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5c2a18e5-615a-4080-a47b-074b3a62366e tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:53.648118 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5c2a18e5-615a-4080-a47b-074b3a62366e tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece" status: 200 len: 1676 microversion: 2.1 time: 0.146930 Jun 29 12:38:53.648673 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 310/643] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:53 2022] GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:54.417664 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3bd07370-f019-45ac-b6ac-42650f43ea25 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:54.418406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3bd07370-f019-45ac-b6ac-42650f43ea25 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:54.425621 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3bd07370-f019-45ac-b6ac-42650f43ea25 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:54.426061 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3bd07370-f019-45ac-b6ac-42650f43ea25 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:54.426841 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3bd07370-f019-45ac-b6ac-42650f43ea25 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:54.427272 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3bd07370-f019-45ac-b6ac-42650f43ea25 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:54.559855 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3bd07370-f019-45ac-b6ac-42650f43ea25 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:54.567837 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3bd07370-f019-45ac-b6ac-42650f43ea25 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:54.569314 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3bd07370-f019-45ac-b6ac-42650f43ea25 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:54.570483 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3bd07370-f019-45ac-b6ac-42650f43ea25 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1723 microversion: 2.20 time: 0.157096 Jun 29 12:38:54.571042 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 334/644] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:38:54 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:38:54.665203 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-65f66965-acbe-4bd3-b53b-68d79df4ed54 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:54.665718 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-65f66965-acbe-4bd3-b53b-68d79df4ed54 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:54.673339 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-65f66965-acbe-4bd3-b53b-68d79df4ed54 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:54.673784 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-65f66965-acbe-4bd3-b53b-68d79df4ed54 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:54.674560 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-65f66965-acbe-4bd3-b53b-68d79df4ed54 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:54.674992 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-65f66965-acbe-4bd3-b53b-68d79df4ed54 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:54.807386 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-65f66965-acbe-4bd3-b53b-68d79df4ed54 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:54.814856 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-65f66965-acbe-4bd3-b53b-68d79df4ed54 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece" status: 200 len: 1676 microversion: 2.1 time: 0.153553 Jun 29 12:38:54.815408 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 311/645] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:54 2022] GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:38:55.588786 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d7d41f5d-a916-4dbe-bac8-f2c25bfa4f37 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:55.589387 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d7d41f5d-a916-4dbe-bac8-f2c25bfa4f37 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:55.595873 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d7d41f5d-a916-4dbe-bac8-f2c25bfa4f37 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:55.596312 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d7d41f5d-a916-4dbe-bac8-f2c25bfa4f37 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:55.597059 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d7d41f5d-a916-4dbe-bac8-f2c25bfa4f37 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:55.597486 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d7d41f5d-a916-4dbe-bac8-f2c25bfa4f37 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:55.727405 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d7d41f5d-a916-4dbe-bac8-f2c25bfa4f37 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:55.736553 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d7d41f5d-a916-4dbe-bac8-f2c25bfa4f37 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:55.738217 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d7d41f5d-a916-4dbe-bac8-f2c25bfa4f37 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:55.739438 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d7d41f5d-a916-4dbe-bac8-f2c25bfa4f37 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1723 microversion: 2.20 time: 0.154619 Jun 29 12:38:55.739987 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 335/646] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:38:55 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:38:55.831569 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-469257b4-e58c-4095-a7e5-1b8a52ff1b06 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:55.832176 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-469257b4-e58c-4095-a7e5-1b8a52ff1b06 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:55.838759 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-469257b4-e58c-4095-a7e5-1b8a52ff1b06 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:55.839212 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-469257b4-e58c-4095-a7e5-1b8a52ff1b06 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:55.839981 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-469257b4-e58c-4095-a7e5-1b8a52ff1b06 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:55.840418 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-469257b4-e58c-4095-a7e5-1b8a52ff1b06 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:55.949433 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-469257b4-e58c-4095-a7e5-1b8a52ff1b06 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a30b65a91a4fd89e8b59df670f60ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f625199b4eb48c98944ea79a90f2841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:55.957005 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-469257b4-e58c-4095-a7e5-1b8a52ff1b06 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece" status: 200 len: 1608 microversion: 2.1 time: 0.129219 Jun 29 12:38:55.957589 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 312/647] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:55 2022] GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece => generated 1608 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:38:56.228617 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-67567800-b1d2-4518-a92e-97428896b7d4 req-35f32023-7abb-49d8-b083-af1c714258fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32214b00-153f-4be8-a43b-7babcb3c0ece", "name": "network-vif-deleted", "tag": "8007b1cc-4e70-43ea-add8-ccc1e13e5610"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:38:56.242635 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-67567800-b1d2-4518-a92e-97428896b7d4 req-35f32023-7abb-49d8-b083-af1c714258fc service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:56.243099 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-67567800-b1d2-4518-a92e-97428896b7d4 req-35f32023-7abb-49d8-b083-af1c714258fc service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:56.263807 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-67567800-b1d2-4518-a92e-97428896b7d4 req-35f32023-7abb-49d8-b083-af1c714258fc service nova] Creating event network-vif-deleted:8007b1cc-4e70-43ea-add8-ccc1e13e5610 for instance 32214b00-153f-4be8-a43b-7babcb3c0ece on hv-cinder-81268 Jun 29 12:38:56.269678 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-67567800-b1d2-4518-a92e-97428896b7d4 req-35f32023-7abb-49d8-b083-af1c714258fc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129500 Jun 29 12:38:56.270891 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 336/648] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:38:56.757253 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-51b4e326-e3f4-4317-9d1e-d2d6206a0a33 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:56.757946 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-51b4e326-e3f4-4317-9d1e-d2d6206a0a33 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:56.764229 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-51b4e326-e3f4-4317-9d1e-d2d6206a0a33 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:56.764678 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-51b4e326-e3f4-4317-9d1e-d2d6206a0a33 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:56.765440 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-51b4e326-e3f4-4317-9d1e-d2d6206a0a33 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:56.765876 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-51b4e326-e3f4-4317-9d1e-d2d6206a0a33 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:56.903012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-51b4e326-e3f4-4317-9d1e-d2d6206a0a33 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:56.911782 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-51b4e326-e3f4-4317-9d1e-d2d6206a0a33 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:56.913274 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-51b4e326-e3f4-4317-9d1e-d2d6206a0a33 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:56.914448 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-51b4e326-e3f4-4317-9d1e-d2d6206a0a33 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1723 microversion: 2.20 time: 0.161234 Jun 29 12:38:56.915016 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 313/649] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:38:56 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:38:56.974316 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-327e8ff1-fdc2-4ec9-b1b1-eecd0c5b3a78 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:56.975045 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-327e8ff1-fdc2-4ec9-b1b1-eecd0c5b3a78 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:56.981851 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-327e8ff1-fdc2-4ec9-b1b1-eecd0c5b3a78 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:56.982315 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-327e8ff1-fdc2-4ec9-b1b1-eecd0c5b3a78 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:56.983308 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-327e8ff1-fdc2-4ec9-b1b1-eecd0c5b3a78 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:56.983942 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-327e8ff1-fdc2-4ec9-b1b1-eecd0c5b3a78 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:56.998854 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-327e8ff1-fdc2-4ec9-b1b1-eecd0c5b3a78 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] HTTP exception thrown: Instance 32214b00-153f-4be8-a43b-7babcb3c0ece could not be found. Jun 29 12:38:57.000808 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-327e8ff1-fdc2-4ec9-b1b1-eecd0c5b3a78 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Request method failure captured: Jun 29 12:38:57.000808 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece HTTP/1.1 Jun 29 12:38:57.000808 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:38:57.000808 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:38:57.000808 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:38:57.000808 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:38:57.000808 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:38:57.000808 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:38:57.000808 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:38:57.000808 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:38:57.000808 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEabXIL6gg7MaO_iQcLyCSpOj-yYEQAE4-EwC2BHNjvXJgBXSyHZiJrkZkCL_QYzSEa5dmCobD4FC0NoEGOHP4QYIHYmZJFnNyp4C6hmRKmQTZVCx6Vti0vfYlx_hga1ycdQs9EhKduLp5TX2R2LyzJgxQ2nPNw9OZJzW84KEA9YjSs Jun 29 12:38:57.000808 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:38:57.000808 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:38:57.000808 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:38:57.000808 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:38:57.000808 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:38:57.000808 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:38:57.000808 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: 0f625199b4eb48c98944ea79a90f2841 Jun 29 12:38:57.000808 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeTestJSON-322810237 Jun 29 12:38:57.000808 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:38:57.000808 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:38:57.002514 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0f625199b4eb48c98944ea79a90f2841", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0f625199b4eb48c98944ea79a90f2841"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0f625199b4eb48c98944ea79a90f2841"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0f625199b4eb48c98944ea79a90f2841"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:38:57.002514 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeTestJSON-322810237 Jun 29 12:38:57.002514 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 0f625199b4eb48c98944ea79a90f2841 Jun 29 12:38:57.002514 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeTestJSON-322810237 Jun 29 12:38:57.002514 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeTestJSON-322810237-project Jun 29 12:38:57.002514 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:38:57.002514 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:38:57.002514 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: a4a30b65a91a4fd89e8b59df670f60ad Jun 29 12:38:57.002514 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeTestJSON-322810237-project Jun 29 12:38:57.002514 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:38:57.002514 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Instance 32214b00-153f-4be8-a43b-7babcb3c0ece could not be found. Jun 29 12:38:57.002514 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': '32214b00-153f-4be8-a43b-7babcb3c0ece'} Jun 29 12:38:57.003406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:38:57.003406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:38:57.003406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:38:57.003406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:38:57.003406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:38:57.003406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:38:57.003406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:38:57.003406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:38:57.003406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:38:57.003406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:38:57.003406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32214b00-153f-4be8-a43b-7babcb3c0ece could not be found. Jun 29 12:38:57.003406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:38:57.003406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:38:57.003406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:38:57.003406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:38:57.003406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:38:57.003406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:38:57.003406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:38:57.003406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:38:57.003406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:38:57.004943 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:38:57.004943 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:38:57.004943 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:38:57.004943 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:38:57.004943 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:38:57.004943 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:38:57.004943 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:38:57.004943 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32214b00-153f-4be8-a43b-7babcb3c0ece could not be found. Jun 29 12:38:57.004943 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:38:57.004943 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:38:57.004943 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:38:57.004943 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:38:57.004943 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:38:57.004943 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:38:57.004943 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:38:57.004943 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:38:57.004943 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32214b00-153f-4be8-a43b-7babcb3c0ece could not be found. Jun 29 12:38:57.004943 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:38:57.007541 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-327e8ff1-fdc2-4ec9-b1b1-eecd0c5b3a78 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Returning 404 to user: Instance 32214b00-153f-4be8-a43b-7babcb3c0ece could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:38:57.008436 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-327e8ff1-fdc2-4ec9-b1b1-eecd0c5b3a78 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece" status: 404 len: 111 microversion: 2.1 time: 0.039061 Jun 29 12:38:57.008990 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 337/650] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:56 2022] GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:38:57.017639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-554a9d93-6ce4-4c4b-acc9-57fc9f448c51 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '.version_select at 0x7fdb068e0310>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:57.036571 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-554a9d93-6ce4-4c4b-acc9-57fc9f448c51 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813030455" status: 202 len: 0 microversion: 2.1 time: 0.022969 Jun 29 12:38:57.037152 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 314/651] 10.222.0.52 () {58 vars in 1220 bytes} [Wed Jun 29 12:38:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813030455 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:38:57.934266 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ab455578-c547-4685-9baa-323c79ce8c6a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:57.934959 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ab455578-c547-4685-9baa-323c79ce8c6a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:57.942203 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ab455578-c547-4685-9baa-323c79ce8c6a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:57.942684 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ab455578-c547-4685-9baa-323c79ce8c6a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:57.943441 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ab455578-c547-4685-9baa-323c79ce8c6a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:57.943877 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ab455578-c547-4685-9baa-323c79ce8c6a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:58.081436 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ab455578-c547-4685-9baa-323c79ce8c6a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:58.089227 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ab455578-c547-4685-9baa-323c79ce8c6a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:58.090746 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ab455578-c547-4685-9baa-323c79ce8c6a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:58.091910 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ab455578-c547-4685-9baa-323c79ce8c6a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1723 microversion: 2.20 time: 0.162438 Jun 29 12:38:58.092451 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 338/652] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:38:57 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:38:59.111266 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ddec6a91-2d58-41cc-9ce8-91237eb3c8a9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:59.111898 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ddec6a91-2d58-41cc-9ce8-91237eb3c8a9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:59.118292 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ddec6a91-2d58-41cc-9ce8-91237eb3c8a9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:59.118763 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ddec6a91-2d58-41cc-9ce8-91237eb3c8a9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:59.119514 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ddec6a91-2d58-41cc-9ce8-91237eb3c8a9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:59.119946 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ddec6a91-2d58-41cc-9ce8-91237eb3c8a9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:59.251808 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ddec6a91-2d58-41cc-9ce8-91237eb3c8a9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:59.259577 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ddec6a91-2d58-41cc-9ce8-91237eb3c8a9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:59.261066 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ddec6a91-2d58-41cc-9ce8-91237eb3c8a9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:38:59.262198 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ddec6a91-2d58-41cc-9ce8-91237eb3c8a9 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1723 microversion: 2.20 time: 0.155601 Jun 29 12:38:59.262780 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 315/653] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:38:59 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:38:59.927779 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5d25a2b3-1394-4597-acc7-28a3a4812239 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:59.928267 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5d25a2b3-1394-4597-acc7-28a3a4812239 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:59.934864 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5d25a2b3-1394-4597-acc7-28a3a4812239 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:59.935317 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5d25a2b3-1394-4597-acc7-28a3a4812239 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:59.936076 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5d25a2b3-1394-4597-acc7-28a3a4812239 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:59.936516 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5d25a2b3-1394-4597-acc7-28a3a4812239 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:59.950083 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-5d25a2b3-1394-4597-acc7-28a3a4812239 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] HTTP exception thrown: Instance 32214b00-153f-4be8-a43b-7babcb3c0ece could not be found. Jun 29 12:38:59.951698 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5d25a2b3-1394-4597-acc7-28a3a4812239 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Request method failure captured: Jun 29 12:38:59.951698 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: DELETE /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece HTTP/1.1 Jun 29 12:38:59.951698 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:38:59.951698 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:38:59.951698 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:38:59.951698 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:38:59.951698 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:38:59.951698 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:38:59.951698 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:38:59.951698 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:38:59.951698 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEabXIL6gg7MaO_iQcLyCSpOj-yYEQAE4-EwC2BHNjvXJgBXSyHZiJrkZkCL_QYzSEa5dmCobD4FC0NoEGOHP4QYIHYmZJFnNyp4C6hmRKmQTZVCx6Vti0vfYlx_hga1ycdQs9EhKduLp5TX2R2LyzJgxQ2nPNw9OZJzW84KEA9YjSs Jun 29 12:38:59.951698 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:38:59.951698 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:38:59.951698 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:38:59.951698 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:38:59.951698 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:38:59.951698 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:38:59.951698 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: 0f625199b4eb48c98944ea79a90f2841 Jun 29 12:38:59.951698 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeTestJSON-322810237 Jun 29 12:38:59.951698 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:38:59.951698 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:38:59.953283 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0f625199b4eb48c98944ea79a90f2841", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0f625199b4eb48c98944ea79a90f2841"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0f625199b4eb48c98944ea79a90f2841"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0f625199b4eb48c98944ea79a90f2841"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:38:59.953283 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeTestJSON-322810237 Jun 29 12:38:59.953283 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 0f625199b4eb48c98944ea79a90f2841 Jun 29 12:38:59.953283 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeTestJSON-322810237 Jun 29 12:38:59.953283 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeTestJSON-322810237-project Jun 29 12:38:59.953283 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:38:59.953283 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:38:59.953283 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: a4a30b65a91a4fd89e8b59df670f60ad Jun 29 12:38:59.953283 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeTestJSON-322810237-project Jun 29 12:38:59.953283 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:38:59.953283 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Instance 32214b00-153f-4be8-a43b-7babcb3c0ece could not be found. Jun 29 12:38:59.953283 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': '32214b00-153f-4be8-a43b-7babcb3c0ece'} Jun 29 12:38:59.955024 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:38:59.955024 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:38:59.955024 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:38:59.955024 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:38:59.955024 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:38:59.955024 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:38:59.955024 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:38:59.955024 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:38:59.955024 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:38:59.955024 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:38:59.955024 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32214b00-153f-4be8-a43b-7babcb3c0ece could not be found. Jun 29 12:38:59.955024 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:38:59.955024 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:38:59.955024 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:38:59.955024 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:38:59.955024 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:38:59.955024 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:38:59.955024 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:38:59.955024 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:38:59.955024 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:38:59.956433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:38:59.956433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 12:38:59.956433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 12:38:59.956433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 12:38:59.956433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 12:38:59.956433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:38:59.956433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:38:59.956433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:38:59.956433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:38:59.956433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32214b00-153f-4be8-a43b-7babcb3c0ece could not be found. Jun 29 12:38:59.956433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:38:59.956433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:38:59.956433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:38:59.956433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:38:59.956433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:38:59.956433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:38:59.956433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:38:59.956433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:38:59.956433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32214b00-153f-4be8-a43b-7babcb3c0ece could not be found. Jun 29 12:38:59.956433 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:38:59.958033 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5d25a2b3-1394-4597-acc7-28a3a4812239 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Returning 404 to user: Instance 32214b00-153f-4be8-a43b-7babcb3c0ece could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:38:59.958033 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5d25a2b3-1394-4597-acc7-28a3a4812239 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "DELETE /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece" status: 404 len: 111 microversion: 2.1 time: 0.029103 Jun 29 12:38:59.958033 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 339/654] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:38:59 2022] DELETE /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:38:59.962037 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e6908ea7-0b5c-4c8a-8c04-3fbddaedf43a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:38:59.962695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e6908ea7-0b5c-4c8a-8c04-3fbddaedf43a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 32214b00-153f-4be8-a43b-7babcb3c0ece] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:38:59.968653 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e6908ea7-0b5c-4c8a-8c04-3fbddaedf43a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:59.969109 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e6908ea7-0b5c-4c8a-8c04-3fbddaedf43a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:59.970158 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e6908ea7-0b5c-4c8a-8c04-3fbddaedf43a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:38:59.970644 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e6908ea7-0b5c-4c8a-8c04-3fbddaedf43a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:38:59.983514 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-e6908ea7-0b5c-4c8a-8c04-3fbddaedf43a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] HTTP exception thrown: Instance 32214b00-153f-4be8-a43b-7babcb3c0ece could not be found. Jun 29 12:38:59.985757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e6908ea7-0b5c-4c8a-8c04-3fbddaedf43a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Request method failure captured: Jun 29 12:38:59.985757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece HTTP/1.1 Jun 29 12:38:59.985757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept: application/json Jun 29 12:38:59.985757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jun 29 12:38:59.985757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Connection: close Jun 29 12:38:59.985757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jun 29 12:38:59.985757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jun 29 12:38:59.985757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Host: 10.222.0.52 Jun 29 12:38:59.985757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jun 29 12:38:59.985757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jun 29 12:38:59.985757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivEabXIL6gg7MaO_iQcLyCSpOj-yYEQAE4-EwC2BHNjvXJgBXSyHZiJrkZkCL_QYzSEa5dmCobD4FC0NoEGOHP4QYIHYmZJFnNyp4C6hmRKmQTZVCx6Vti0vfYlx_hga1ycdQs9EhKduLp5TX2R2LyzJgxQ2nPNw9OZJzW84KEA9YjSs Jun 29 12:38:59.985757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jun 29 12:38:59.985757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jun 29 12:38:59.985757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jun 29 12:38:59.985757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jun 29 12:38:59.985757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jun 29 12:38:59.985757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jun 29 12:38:59.985757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Id: 0f625199b4eb48c98944ea79a90f2841 Jun 29 12:38:59.985757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-AttachVolumeTestJSON-322810237 Jun 29 12:38:59.985757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jun 29 12:38:59.985757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jun 29 12:38:59.987360 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0f625199b4eb48c98944ea79a90f2841", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0f625199b4eb48c98944ea79a90f2841"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0f625199b4eb48c98944ea79a90f2841"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0f625199b4eb48c98944ea79a90f2841"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:38:59.987360 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-AttachVolumeTestJSON-322810237 Jun 29 12:38:59.987360 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Id: 0f625199b4eb48c98944ea79a90f2841 Jun 29 12:38:59.987360 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-AttachVolumeTestJSON-322810237 Jun 29 12:38:59.987360 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User: tempest-AttachVolumeTestJSON-322810237-project Jun 29 12:38:59.987360 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jun 29 12:38:59.987360 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jun 29 12:38:59.987360 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Id: a4a30b65a91a4fd89e8b59df670f60ad Jun 29 12:38:59.987360 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-AttachVolumeTestJSON-322810237-project Jun 29 12:38:59.987360 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: method: > Jun 29 12:38:59.987360 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: exception: Instance 32214b00-153f-4be8-a43b-7babcb3c0ece could not be found. Jun 29 12:38:59.987360 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: action_args: {'id': '32214b00-153f-4be8-a43b-7babcb3c0ece'} Jun 29 12:38:59.988362 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:38:59.988362 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:38:59.988362 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:38:59.988362 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:38:59.988362 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:38:59.988362 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:38:59.988362 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:38:59.988362 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:38:59.988362 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:38:59.988362 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:38:59.988362 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32214b00-153f-4be8-a43b-7babcb3c0ece could not be found. Jun 29 12:38:59.988362 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:38:59.988362 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:38:59.988362 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:38:59.988362 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:38:59.988362 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:38:59.988362 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:38:59.988362 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:38:59.988362 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:38:59.988362 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:38:59.989843 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:38:59.989843 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:38:59.989843 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:38:59.989843 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:38:59.989843 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:38:59.989843 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:38:59.989843 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:38:59.989843 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32214b00-153f-4be8-a43b-7babcb3c0ece could not be found. Jun 29 12:38:59.989843 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:38:59.989843 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:38:59.989843 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:38:59.989843 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:38:59.989843 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:38:59.989843 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:38:59.989843 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:38:59.989843 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:38:59.989843 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32214b00-153f-4be8-a43b-7babcb3c0ece could not be found. Jun 29 12:38:59.989843 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:38:59.991338 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e6908ea7-0b5c-4c8a-8c04-3fbddaedf43a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Returning 404 to user: Instance 32214b00-153f-4be8-a43b-7babcb3c0ece could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:38:59.991338 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e6908ea7-0b5c-4c8a-8c04-3fbddaedf43a tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece" status: 404 len: 111 microversion: 2.1 time: 0.028992 Jun 29 12:38:59.991338 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 316/655] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:38:59 2022] GET /compute/v2.1/servers/32214b00-153f-4be8-a43b-7babcb3c0ece => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:39:00.280998 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9920ba5c-a445-4157-9a7e-bf526f040789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:00.281605 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-9920ba5c-a445-4157-9a7e-bf526f040789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:00.287718 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9920ba5c-a445-4157-9a7e-bf526f040789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:00.288167 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9920ba5c-a445-4157-9a7e-bf526f040789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:00.288921 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9920ba5c-a445-4157-9a7e-bf526f040789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:00.289353 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9920ba5c-a445-4157-9a7e-bf526f040789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:00.417969 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-9920ba5c-a445-4157-9a7e-bf526f040789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:00.426341 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-9920ba5c-a445-4157-9a7e-bf526f040789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:00.427854 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-9920ba5c-a445-4157-9a7e-bf526f040789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:00.428995 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-9920ba5c-a445-4157-9a7e-bf526f040789 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1723 microversion: 2.20 time: 0.151918 Jun 29 12:39:00.429533 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 340/656] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:00 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:01.121852 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a103d5be-ab27-4baf-9ab2-29f40b3d877b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:01.122334 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a103d5be-ab27-4baf-9ab2-29f40b3d877b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:01.129542 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a103d5be-ab27-4baf-9ab2-29f40b3d877b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:01.129985 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a103d5be-ab27-4baf-9ab2-29f40b3d877b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:01.130773 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a103d5be-ab27-4baf-9ab2-29f40b3d877b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:01.131215 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a103d5be-ab27-4baf-9ab2-29f40b3d877b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:01.144984 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-a103d5be-ab27-4baf-9ab2-29f40b3d877b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] HTTP exception thrown: Instance 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 could not be found. Jun 29 12:39:01.146915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a103d5be-ab27-4baf-9ab2-29f40b3d877b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Request method failure captured: Jun 29 12:39:01.146915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: request: DELETE /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 HTTP/1.1 Jun 29 12:39:01.146915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept: application/json Jun 29 12:39:01.146915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jun 29 12:39:01.146915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Connection: close Jun 29 12:39:01.146915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jun 29 12:39:01.146915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jun 29 12:39:01.146915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Host: 10.222.0.52 Jun 29 12:39:01.146915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jun 29 12:39:01.146915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jun 29 12:39:01.146915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivEabXIL6gg7MaO_iQcLyCSpOj-yYEQAE4-EwC2BHNjvXJgBXSyHZiJrkZkCL_QYzSEa5dmCobD4FC0NoEGOHP4QYIHYmZJFnNyp4C6hmRKmQTZVCx6Vti0vfYlx_hga1ycdQs9EhKduLp5TX2R2LyzJgxQ2nPNw9OZJzW84KEA9YjSs Jun 29 12:39:01.146915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jun 29 12:39:01.146915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jun 29 12:39:01.146915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jun 29 12:39:01.146915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jun 29 12:39:01.146915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jun 29 12:39:01.146915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jun 29 12:39:01.146915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Id: 0f625199b4eb48c98944ea79a90f2841 Jun 29 12:39:01.146915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-AttachVolumeTestJSON-322810237 Jun 29 12:39:01.146915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jun 29 12:39:01.146915 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jun 29 12:39:01.148417 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0f625199b4eb48c98944ea79a90f2841", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0f625199b4eb48c98944ea79a90f2841"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0f625199b4eb48c98944ea79a90f2841"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0f625199b4eb48c98944ea79a90f2841"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:39:01.148417 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-AttachVolumeTestJSON-322810237 Jun 29 12:39:01.148417 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Id: 0f625199b4eb48c98944ea79a90f2841 Jun 29 12:39:01.148417 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-AttachVolumeTestJSON-322810237 Jun 29 12:39:01.148417 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User: tempest-AttachVolumeTestJSON-322810237-project Jun 29 12:39:01.148417 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jun 29 12:39:01.148417 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jun 29 12:39:01.148417 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Id: a4a30b65a91a4fd89e8b59df670f60ad Jun 29 12:39:01.148417 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-AttachVolumeTestJSON-322810237-project Jun 29 12:39:01.148417 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: method: > Jun 29 12:39:01.148417 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: exception: Instance 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 could not be found. Jun 29 12:39:01.148417 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: action_args: {'id': '850c462a-25ae-40e2-a43b-fdf1ec4ab8e4'} Jun 29 12:39:01.149214 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:39:01.149214 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:39:01.149214 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:39:01.149214 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:39:01.149214 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:39:01.149214 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:39:01.149214 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:39:01.149214 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:39:01.149214 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:39:01.149214 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:39:01.149214 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 could not be found. Jun 29 12:39:01.149214 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:39:01.149214 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:39:01.149214 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:39:01.149214 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:39:01.149214 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:39:01.149214 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:39:01.149214 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:39:01.149214 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:39:01.149214 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:39:01.150469 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:39:01.150469 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 12:39:01.150469 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 12:39:01.150469 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 12:39:01.150469 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 12:39:01.150469 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:39:01.150469 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:39:01.150469 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:39:01.150469 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:39:01.150469 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 could not be found. Jun 29 12:39:01.150469 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:39:01.150469 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:39:01.150469 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:39:01.150469 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:39:01.150469 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:39:01.150469 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:39:01.150469 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:39:01.150469 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:39:01.150469 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 could not be found. Jun 29 12:39:01.150469 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:39:01.151634 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a103d5be-ab27-4baf-9ab2-29f40b3d877b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Returning 404 to user: Instance 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:39:01.151634 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a103d5be-ab27-4baf-9ab2-29f40b3d877b tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "DELETE /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 404 len: 111 microversion: 2.1 time: 0.030253 Jun 29 12:39:01.151634 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 317/657] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:39:01 2022] DELETE /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:39:01.156710 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-62f5fe88-172d-499e-870d-f3619468c1e3 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:01.157537 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-62f5fe88-172d-499e-870d-f3619468c1e3 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] [instance: 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:01.163747 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-62f5fe88-172d-499e-870d-f3619468c1e3 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:01.164174 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-62f5fe88-172d-499e-870d-f3619468c1e3 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:01.164921 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-62f5fe88-172d-499e-870d-f3619468c1e3 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:01.165473 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-62f5fe88-172d-499e-870d-f3619468c1e3 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:01.178284 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-62f5fe88-172d-499e-870d-f3619468c1e3 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] HTTP exception thrown: Instance 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 could not be found. Jun 29 12:39:01.179811 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-62f5fe88-172d-499e-870d-f3619468c1e3 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Request method failure captured: Jun 29 12:39:01.179811 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 HTTP/1.1 Jun 29 12:39:01.179811 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:39:01.179811 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:39:01.179811 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:39:01.179811 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:39:01.179811 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:39:01.179811 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:39:01.179811 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:39:01.179811 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:39:01.179811 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEabXIL6gg7MaO_iQcLyCSpOj-yYEQAE4-EwC2BHNjvXJgBXSyHZiJrkZkCL_QYzSEa5dmCobD4FC0NoEGOHP4QYIHYmZJFnNyp4C6hmRKmQTZVCx6Vti0vfYlx_hga1ycdQs9EhKduLp5TX2R2LyzJgxQ2nPNw9OZJzW84KEA9YjSs Jun 29 12:39:01.179811 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:39:01.179811 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:39:01.179811 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:39:01.179811 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:39:01.179811 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:39:01.179811 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:39:01.179811 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: 0f625199b4eb48c98944ea79a90f2841 Jun 29 12:39:01.179811 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeTestJSON-322810237 Jun 29 12:39:01.179811 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:39:01.179811 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:39:01.181407 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0f625199b4eb48c98944ea79a90f2841", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0f625199b4eb48c98944ea79a90f2841"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0f625199b4eb48c98944ea79a90f2841"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0f625199b4eb48c98944ea79a90f2841"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:39:01.181407 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeTestJSON-322810237 Jun 29 12:39:01.181407 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 0f625199b4eb48c98944ea79a90f2841 Jun 29 12:39:01.181407 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeTestJSON-322810237 Jun 29 12:39:01.181407 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeTestJSON-322810237-project Jun 29 12:39:01.181407 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:39:01.181407 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:39:01.181407 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: a4a30b65a91a4fd89e8b59df670f60ad Jun 29 12:39:01.181407 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeTestJSON-322810237-project Jun 29 12:39:01.181407 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:39:01.181407 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Instance 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 could not be found. Jun 29 12:39:01.181407 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': '850c462a-25ae-40e2-a43b-fdf1ec4ab8e4'} Jun 29 12:39:01.182292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:39:01.182292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:39:01.182292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:39:01.182292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:39:01.182292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:39:01.182292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:39:01.182292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:39:01.182292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:39:01.182292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:39:01.182292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:39:01.182292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 could not be found. Jun 29 12:39:01.182292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:39:01.182292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:39:01.182292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:39:01.182292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:39:01.182292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:39:01.182292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:39:01.182292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:39:01.182292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:39:01.182292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:39:01.183753 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:39:01.183753 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:39:01.183753 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:39:01.183753 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:39:01.183753 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:39:01.183753 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:39:01.183753 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:39:01.183753 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 could not be found. Jun 29 12:39:01.183753 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:39:01.183753 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:39:01.183753 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:39:01.183753 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:39:01.183753 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:39:01.183753 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:39:01.183753 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:39:01.183753 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:39:01.183753 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 could not be found. Jun 29 12:39:01.183753 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:39:01.185176 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-62f5fe88-172d-499e-870d-f3619468c1e3 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] Returning 404 to user: Instance 850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:39:01.185176 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-62f5fe88-172d-499e-870d-f3619468c1e3 tempest-AttachVolumeTestJSON-322810237 tempest-AttachVolumeTestJSON-322810237-project] 10.222.0.52 "GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4" status: 404 len: 111 microversion: 2.1 time: 0.028235 Jun 29 12:39:01.185176 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 341/658] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:39:01 2022] GET /compute/v2.1/servers/850c462a-25ae-40e2-a43b-fdf1ec4ab8e4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:39:01.447467 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-7370dd7a-a6d9-4694-b0ff-cae942198759 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:01.448184 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-7370dd7a-a6d9-4694-b0ff-cae942198759 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:01.455598 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7370dd7a-a6d9-4694-b0ff-cae942198759 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:01.456129 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7370dd7a-a6d9-4694-b0ff-cae942198759 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:01.456901 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7370dd7a-a6d9-4694-b0ff-cae942198759 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:01.457342 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7370dd7a-a6d9-4694-b0ff-cae942198759 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:01.592019 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7370dd7a-a6d9-4694-b0ff-cae942198759 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:01.600512 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7370dd7a-a6d9-4694-b0ff-cae942198759 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:01.602185 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7370dd7a-a6d9-4694-b0ff-cae942198759 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:01.603392 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-7370dd7a-a6d9-4694-b0ff-cae942198759 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1723 microversion: 2.20 time: 0.159846 Jun 29 12:39:01.603946 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 318/659] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:01 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:02.622064 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-98e6c92a-49fb-4a08-a13b-98b56cd2ce6e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:02.622947 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-98e6c92a-49fb-4a08-a13b-98b56cd2ce6e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:02.630690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-98e6c92a-49fb-4a08-a13b-98b56cd2ce6e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:02.631140 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-98e6c92a-49fb-4a08-a13b-98b56cd2ce6e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:02.631918 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-98e6c92a-49fb-4a08-a13b-98b56cd2ce6e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:02.632353 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-98e6c92a-49fb-4a08-a13b-98b56cd2ce6e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:02.874215 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-98e6c92a-49fb-4a08-a13b-98b56cd2ce6e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:02.882221 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-98e6c92a-49fb-4a08-a13b-98b56cd2ce6e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:02.883844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-98e6c92a-49fb-4a08-a13b-98b56cd2ce6e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:02.885410 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-98e6c92a-49fb-4a08-a13b-98b56cd2ce6e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1723 microversion: 2.20 time: 0.267313 Jun 29 12:39:02.896620 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 342/660] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:02 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:03.904447 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ace376f5-ef2c-4d08-a4d5-185d49a4038a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:03.905057 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ace376f5-ef2c-4d08-a4d5-185d49a4038a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:03.920394 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ace376f5-ef2c-4d08-a4d5-185d49a4038a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:03.920849 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ace376f5-ef2c-4d08-a4d5-185d49a4038a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:03.921641 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ace376f5-ef2c-4d08-a4d5-185d49a4038a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:03.922070 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ace376f5-ef2c-4d08-a4d5-185d49a4038a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:04.088005 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ace376f5-ef2c-4d08-a4d5-185d49a4038a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:04.101232 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ace376f5-ef2c-4d08-a4d5-185d49a4038a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:04.102769 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ace376f5-ef2c-4d08-a4d5-185d49a4038a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:04.104153 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ace376f5-ef2c-4d08-a4d5-185d49a4038a tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1723 microversion: 2.20 time: 0.203642 Jun 29 12:39:04.105248 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 319/661] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:03 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:05.123115 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0fdcb9ea-cec1-4609-9ba2-a1da3d740505 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:05.123838 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0fdcb9ea-cec1-4609-9ba2-a1da3d740505 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:05.131037 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0fdcb9ea-cec1-4609-9ba2-a1da3d740505 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:05.131481 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0fdcb9ea-cec1-4609-9ba2-a1da3d740505 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:05.132233 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0fdcb9ea-cec1-4609-9ba2-a1da3d740505 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:05.132666 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0fdcb9ea-cec1-4609-9ba2-a1da3d740505 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:05.269460 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0fdcb9ea-cec1-4609-9ba2-a1da3d740505 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:05.277733 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0fdcb9ea-cec1-4609-9ba2-a1da3d740505 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:05.279263 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0fdcb9ea-cec1-4609-9ba2-a1da3d740505 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:05.280408 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0fdcb9ea-cec1-4609-9ba2-a1da3d740505 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1723 microversion: 2.20 time: 0.161535 Jun 29 12:39:05.280936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 343/662] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:05 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:06.300204 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8ef10a84-4b59-4f14-a35b-5f7bc7a1d54f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:06.300946 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8ef10a84-4b59-4f14-a35b-5f7bc7a1d54f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:06.308338 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8ef10a84-4b59-4f14-a35b-5f7bc7a1d54f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:06.308794 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8ef10a84-4b59-4f14-a35b-5f7bc7a1d54f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:06.309563 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8ef10a84-4b59-4f14-a35b-5f7bc7a1d54f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:06.310001 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8ef10a84-4b59-4f14-a35b-5f7bc7a1d54f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:06.457115 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8ef10a84-4b59-4f14-a35b-5f7bc7a1d54f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:06.464896 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8ef10a84-4b59-4f14-a35b-5f7bc7a1d54f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:06.466402 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8ef10a84-4b59-4f14-a35b-5f7bc7a1d54f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:06.467578 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8ef10a84-4b59-4f14-a35b-5f7bc7a1d54f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1723 microversion: 2.20 time: 0.172324 Jun 29 12:39:06.468137 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 320/663] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:06 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:07.486340 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e0f4d17a-a653-40dc-910c-f76cc7115e72 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:07.486990 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e0f4d17a-a653-40dc-910c-f76cc7115e72 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:07.493373 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e0f4d17a-a653-40dc-910c-f76cc7115e72 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:07.493820 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e0f4d17a-a653-40dc-910c-f76cc7115e72 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:07.494605 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e0f4d17a-a653-40dc-910c-f76cc7115e72 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:07.495037 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e0f4d17a-a653-40dc-910c-f76cc7115e72 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:07.638137 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e0f4d17a-a653-40dc-910c-f76cc7115e72 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:07.648371 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e0f4d17a-a653-40dc-910c-f76cc7115e72 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:07.650140 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e0f4d17a-a653-40dc-910c-f76cc7115e72 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:07.651579 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e0f4d17a-a653-40dc-910c-f76cc7115e72 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1723 microversion: 2.20 time: 0.169783 Jun 29 12:39:07.652137 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 344/664] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:07 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:08.670351 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6736b067-7f62-465f-9ca2-70047671b5ba tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:08.670923 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6736b067-7f62-465f-9ca2-70047671b5ba tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:08.677996 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6736b067-7f62-465f-9ca2-70047671b5ba tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:08.678468 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6736b067-7f62-465f-9ca2-70047671b5ba tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:08.679232 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6736b067-7f62-465f-9ca2-70047671b5ba tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:08.679669 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6736b067-7f62-465f-9ca2-70047671b5ba tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:08.810449 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6736b067-7f62-465f-9ca2-70047671b5ba tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:08.819485 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6736b067-7f62-465f-9ca2-70047671b5ba tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:08.821029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6736b067-7f62-465f-9ca2-70047671b5ba tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:08.822254 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6736b067-7f62-465f-9ca2-70047671b5ba tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1744 microversion: 2.20 time: 0.155842 Jun 29 12:39:08.827637 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 321/665] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:08 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:09.841052 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b254ed62-76d0-41b1-bcd0-95b24e0da5b2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:09.841656 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b254ed62-76d0-41b1-bcd0-95b24e0da5b2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:09.848645 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b254ed62-76d0-41b1-bcd0-95b24e0da5b2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:09.849089 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b254ed62-76d0-41b1-bcd0-95b24e0da5b2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:09.849839 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b254ed62-76d0-41b1-bcd0-95b24e0da5b2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:09.850303 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b254ed62-76d0-41b1-bcd0-95b24e0da5b2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:09.981660 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b254ed62-76d0-41b1-bcd0-95b24e0da5b2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:09.989618 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b254ed62-76d0-41b1-bcd0-95b24e0da5b2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:09.991244 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b254ed62-76d0-41b1-bcd0-95b24e0da5b2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:09.992471 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b254ed62-76d0-41b1-bcd0-95b24e0da5b2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1744 microversion: 2.20 time: 0.155251 Jun 29 12:39:09.993024 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 345/666] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:09 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:10.390154 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-83dff7c8-d81b-4040-b01e-5e699f296914 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:10.390696 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-83dff7c8-d81b-4040-b01e-5e699f296914 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: c8419121-12d7-431e-9ff0-dfa04c64cd00] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:10.398351 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-83dff7c8-d81b-4040-b01e-5e699f296914 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:10.398968 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-83dff7c8-d81b-4040-b01e-5e699f296914 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:10.399889 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-83dff7c8-d81b-4040-b01e-5e699f296914 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:10.400329 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-83dff7c8-d81b-4040-b01e-5e699f296914 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:10.423473 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-83dff7c8-d81b-4040-b01e-5e699f296914 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00/ips" status: 200 len: 150 microversion: 2.1 time: 0.037183 Jun 29 12:39:10.424160 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 322/667] 10.222.0.52 () {58 vars in 1247 bytes} [Wed Jun 29 12:39:10 2022] GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:39:11.010584 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-39edf5a2-427d-4a64-9338-ab953df95adc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:11.011213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-39edf5a2-427d-4a64-9338-ab953df95adc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:11.018204 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-39edf5a2-427d-4a64-9338-ab953df95adc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:11.018672 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-39edf5a2-427d-4a64-9338-ab953df95adc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:11.019425 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-39edf5a2-427d-4a64-9338-ab953df95adc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:11.019861 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-39edf5a2-427d-4a64-9338-ab953df95adc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:11.153099 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-39edf5a2-427d-4a64-9338-ab953df95adc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:11.161472 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-39edf5a2-427d-4a64-9338-ab953df95adc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:11.163030 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-39edf5a2-427d-4a64-9338-ab953df95adc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:11.164162 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-39edf5a2-427d-4a64-9338-ab953df95adc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1744 microversion: 2.20 time: 0.157533 Jun 29 12:39:11.164707 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 346/668] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:11 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:12.182300 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-47ebfd67-1921-4000-a70d-6136241d329f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:12.182967 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-47ebfd67-1921-4000-a70d-6136241d329f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:12.189998 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-47ebfd67-1921-4000-a70d-6136241d329f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:12.190472 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-47ebfd67-1921-4000-a70d-6136241d329f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:12.192191 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-47ebfd67-1921-4000-a70d-6136241d329f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:12.192719 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-47ebfd67-1921-4000-a70d-6136241d329f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:12.318440 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-47ebfd67-1921-4000-a70d-6136241d329f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:12.326225 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-47ebfd67-1921-4000-a70d-6136241d329f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:12.327763 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-47ebfd67-1921-4000-a70d-6136241d329f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:12.328923 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-47ebfd67-1921-4000-a70d-6136241d329f tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1744 microversion: 2.20 time: 0.150476 Jun 29 12:39:12.329472 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 323/669] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:12 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:13.347202 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-33bdfaf1-ce69-49d4-bb43-480c796b45a3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:13.347805 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-33bdfaf1-ce69-49d4-bb43-480c796b45a3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:13.354598 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-33bdfaf1-ce69-49d4-bb43-480c796b45a3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:13.355254 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-33bdfaf1-ce69-49d4-bb43-480c796b45a3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:13.356180 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-33bdfaf1-ce69-49d4-bb43-480c796b45a3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:13.356612 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-33bdfaf1-ce69-49d4-bb43-480c796b45a3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:13.381176 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:39:13.512649 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-33bdfaf1-ce69-49d4-bb43-480c796b45a3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:13.521584 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-33bdfaf1-ce69-49d4-bb43-480c796b45a3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:13.523077 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-33bdfaf1-ce69-49d4-bb43-480c796b45a3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:13.524481 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-33bdfaf1-ce69-49d4-bb43-480c796b45a3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1739 microversion: 2.20 time: 0.181446 Jun 29 12:39:13.525033 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 347/670] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:13 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:13.888384 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2b416a48-5f23-416c-ba90-b79a9a581e94 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38cbf88d-cec2-422b-8d8d-65219bf0f328"}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:39:13.890452 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2b416a48-5f23-416c-ba90-b79a9a581e94 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: c8419121-12d7-431e-9ff0-dfa04c64cd00] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:13.899462 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2b416a48-5f23-416c-ba90-b79a9a581e94 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:13.899921 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2b416a48-5f23-416c-ba90-b79a9a581e94 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:13.900707 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2b416a48-5f23-416c-ba90-b79a9a581e94 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:13.901150 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2b416a48-5f23-416c-ba90-b79a9a581e94 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:14.215288 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2b416a48-5f23-416c-ba90-b79a9a581e94 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "POST /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328962 Jun 29 12:39:14.216019 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 324/671] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Jun 29 12:39:13 2022] POST /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00/os-volume_attachments => generated 194 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:39:14.543301 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-754b3da6-73bb-45c4-a9db-d7561e2f7752 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:14.544564 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-754b3da6-73bb-45c4-a9db-d7561e2f7752 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:14.556647 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-754b3da6-73bb-45c4-a9db-d7561e2f7752 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:14.557455 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-754b3da6-73bb-45c4-a9db-d7561e2f7752 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:14.558868 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-754b3da6-73bb-45c4-a9db-d7561e2f7752 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:14.559650 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-754b3da6-73bb-45c4-a9db-d7561e2f7752 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:14.773327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-17ef16e3-0b33-4f49-85ea-c40c1c0e5b95 req-1e561d2b-247e-495b-b16f-50c75fa1322e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6005eeb-de9c-4299-85da-6bf176fba2db", "name": "network-vif-plugged", "status": "completed", "tag": "91513e0c-31ea-42a7-a298-8bcc2b5e8547"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:39:14.782848 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-754b3da6-73bb-45c4-a9db-d7561e2f7752 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:14.789342 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-17ef16e3-0b33-4f49-85ea-c40c1c0e5b95 req-1e561d2b-247e-495b-b16f-50c75fa1322e service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:14.789833 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-17ef16e3-0b33-4f49-85ea-c40c1c0e5b95 req-1e561d2b-247e-495b-b16f-50c75fa1322e service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:14.791735 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-754b3da6-73bb-45c4-a9db-d7561e2f7752 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:14.793528 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-754b3da6-73bb-45c4-a9db-d7561e2f7752 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:14.794559 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-754b3da6-73bb-45c4-a9db-d7561e2f7752 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1739 microversion: 2.20 time: 0.255231 Jun 29 12:39:14.795108 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 348/672] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:14 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1739 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:14.806615 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-17ef16e3-0b33-4f49-85ea-c40c1c0e5b95 req-1e561d2b-247e-495b-b16f-50c75fa1322e service nova] Creating event network-vif-plugged:91513e0c-31ea-42a7-a298-8bcc2b5e8547 for instance b6005eeb-de9c-4299-85da-6bf176fba2db on hv-cinder-81268 Jun 29 12:39:14.811644 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-17ef16e3-0b33-4f49-85ea-c40c1c0e5b95 req-1e561d2b-247e-495b-b16f-50c75fa1322e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229837 Jun 29 12:39:14.812240 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 325/673] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:39:15.814374 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d08e146c-27a6-4893-a5f5-808b0fca7b55 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:15.815021 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d08e146c-27a6-4893-a5f5-808b0fca7b55 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:15.822265 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d08e146c-27a6-4893-a5f5-808b0fca7b55 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:15.822752 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d08e146c-27a6-4893-a5f5-808b0fca7b55 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:15.823538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d08e146c-27a6-4893-a5f5-808b0fca7b55 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:15.823978 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d08e146c-27a6-4893-a5f5-808b0fca7b55 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:15.974256 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d08e146c-27a6-4893-a5f5-808b0fca7b55 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:15.982615 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d08e146c-27a6-4893-a5f5-808b0fca7b55 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:15.984115 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d08e146c-27a6-4893-a5f5-808b0fca7b55 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:15.985938 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d08e146c-27a6-4893-a5f5-808b0fca7b55 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1739 microversion: 2.20 time: 0.176443 Jun 29 12:39:15.986706 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 349/674] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:15 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:17.006058 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-371cd063-c98a-4679-a19c-bc9ea4ededa7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:17.006797 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-371cd063-c98a-4679-a19c-bc9ea4ededa7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:17.018210 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-371cd063-c98a-4679-a19c-bc9ea4ededa7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:17.018697 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-371cd063-c98a-4679-a19c-bc9ea4ededa7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:17.019480 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-371cd063-c98a-4679-a19c-bc9ea4ededa7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:17.020088 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-371cd063-c98a-4679-a19c-bc9ea4ededa7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:17.025257 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:39:17.208378 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-371cd063-c98a-4679-a19c-bc9ea4ededa7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:17.217338 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-371cd063-c98a-4679-a19c-bc9ea4ededa7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:17.219699 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-371cd063-c98a-4679-a19c-bc9ea4ededa7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:17.221260 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-371cd063-c98a-4679-a19c-bc9ea4ededa7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1739 microversion: 2.20 time: 0.220893 Jun 29 12:39:17.234218 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 326/675] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:16 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:18.243628 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6ccdf8b4-2b85-4a75-a001-5c91671d3ace tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:18.245019 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-6ccdf8b4-2b85-4a75-a001-5c91671d3ace tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:18.252751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6ccdf8b4-2b85-4a75-a001-5c91671d3ace tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:18.253207 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6ccdf8b4-2b85-4a75-a001-5c91671d3ace tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:18.254531 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6ccdf8b4-2b85-4a75-a001-5c91671d3ace tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:18.254531 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6ccdf8b4-2b85-4a75-a001-5c91671d3ace tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:18.419560 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6ccdf8b4-2b85-4a75-a001-5c91671d3ace tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:18.429426 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6ccdf8b4-2b85-4a75-a001-5c91671d3ace tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:18.431751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6ccdf8b4-2b85-4a75-a001-5c91671d3ace tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:18.432958 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6ccdf8b4-2b85-4a75-a001-5c91671d3ace tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1739 microversion: 2.20 time: 0.193693 Jun 29 12:39:18.433518 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 350/676] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:18 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:19.451298 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d7563c1a-24e2-41e6-97d0-c2461a109634 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:19.451912 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d7563c1a-24e2-41e6-97d0-c2461a109634 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:19.455712 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:39:19.462255 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d7563c1a-24e2-41e6-97d0-c2461a109634 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:19.462828 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d7563c1a-24e2-41e6-97d0-c2461a109634 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:19.463821 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d7563c1a-24e2-41e6-97d0-c2461a109634 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:19.464503 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d7563c1a-24e2-41e6-97d0-c2461a109634 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:19.637917 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d7563c1a-24e2-41e6-97d0-c2461a109634 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:19.662040 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d7563c1a-24e2-41e6-97d0-c2461a109634 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:19.667230 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d7563c1a-24e2-41e6-97d0-c2461a109634 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:19.673192 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d7563c1a-24e2-41e6-97d0-c2461a109634 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1739 microversion: 2.20 time: 0.222490 Jun 29 12:39:19.684728 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 327/677] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:19 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1739 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:20.695601 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-83fb3b11-4f3a-4aea-91cf-ab38d4759d95 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:20.696822 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-83fb3b11-4f3a-4aea-91cf-ab38d4759d95 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:20.699368 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:39:20.713794 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-83fb3b11-4f3a-4aea-91cf-ab38d4759d95 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:20.716847 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-83fb3b11-4f3a-4aea-91cf-ab38d4759d95 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:20.717874 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-83fb3b11-4f3a-4aea-91cf-ab38d4759d95 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:20.721386 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-83fb3b11-4f3a-4aea-91cf-ab38d4759d95 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:20.947912 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-83fb3b11-4f3a-4aea-91cf-ab38d4759d95 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:20.957232 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-83fb3b11-4f3a-4aea-91cf-ab38d4759d95 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:20.958744 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-83fb3b11-4f3a-4aea-91cf-ab38d4759d95 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:20.960146 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-83fb3b11-4f3a-4aea-91cf-ab38d4759d95 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1739 microversion: 2.20 time: 0.271617 Jun 29 12:39:20.970514 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 351/678] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:20 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1739 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:21.868463 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0d8b0413-4295-42b9-be0f-2cf16b873eb9 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Action: 'create', calling method: .version_select at 0x7fdb0680d160>, body: {"keypair": {"name": "tempest-keypair-1258415520", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHG8kUS6C7EXPCUcRMroK3kVuyxy9NJeSJhGYhChPCnI9o6N38PZoqK7q0zUMcF/pJoHv93IVnDHlLZuCKOhvXcPA4gQuAmcIdZN9j9uDzzDcgRKryvB/dKVv06QUyVYPw=="}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:39:21.897399 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-0d8b0413-4295-42b9-be0f-2cf16b873eb9 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Getting quotas for project f18ffa75c23e4276a8b5b4fc3821fb87. Resources: {'key_pairs'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:39:21.902741 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-0d8b0413-4295-42b9-be0f-2cf16b873eb9 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Getting quotas for user 2af4d4a69e9d4755bff61401f4349c78 and project f18ffa75c23e4276a8b5b4fc3821fb87. Resources: {'key_pairs'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:39:21.941642 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0d8b0413-4295-42b9-be0f-2cf16b873eb9 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.076921 Jun 29 12:39:21.942402 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 328/679] 10.222.0.52 () {60 vars in 1158 bytes} [Wed Jun 29 12:39:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:39:21.979438 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b75ec60f-a761-44ac-b5c0-db421430fab4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:21.980041 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b75ec60f-a761-44ac-b5c0-db421430fab4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:21.991971 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b75ec60f-a761-44ac-b5c0-db421430fab4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:21.992440 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b75ec60f-a761-44ac-b5c0-db421430fab4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:21.993203 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b75ec60f-a761-44ac-b5c0-db421430fab4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:21.993634 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b75ec60f-a761-44ac-b5c0-db421430fab4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:22.213457 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b75ec60f-a761-44ac-b5c0-db421430fab4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:22.234277 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b75ec60f-a761-44ac-b5c0-db421430fab4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:22.237997 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b75ec60f-a761-44ac-b5c0-db421430fab4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:22.239309 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b75ec60f-a761-44ac-b5c0-db421430fab4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1739 microversion: 2.20 time: 0.263846 Jun 29 12:39:22.246842 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 352/680] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:21 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1739 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:39:23.263556 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9cc54218-a51e-475d-a6d3-1aa205886523 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:23.264253 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-9cc54218-a51e-475d-a6d3-1aa205886523 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:23.272549 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9cc54218-a51e-475d-a6d3-1aa205886523 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:23.273035 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9cc54218-a51e-475d-a6d3-1aa205886523 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:23.273871 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9cc54218-a51e-475d-a6d3-1aa205886523 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:23.274310 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9cc54218-a51e-475d-a6d3-1aa205886523 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:23.429500 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9cc54218-a51e-475d-a6d3-1aa205886523 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:23.443348 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9cc54218-a51e-475d-a6d3-1aa205886523 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:23.444244 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9cc54218-a51e-475d-a6d3-1aa205886523 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:23.445429 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9cc54218-a51e-475d-a6d3-1aa205886523 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1739 microversion: 2.20 time: 0.186275 Jun 29 12:39:23.445981 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 329/681] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:23 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:23.570990 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-036f775f-2dae-4d6f-8b25-a81b43a2e831 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-38939304", "imageRef": "70887696-f652-46b0-a5be-bfb400986078", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a4c9384-2272-4ef8-9e7c-74de83b9d3b0"}], "security_groups": [{"name": "tempest-securitygroup--672690097"}], "key_name": "tempest-keypair-1258415520", "user_data": "}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:39:23.674115 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.network.neutron [None req-036f775f-2dae-4d6f-8b25-a81b43a2e831 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] validate_networks() for [('9a4c9384-2272-4ef8-9e7c-74de83b9d3b0', None, None, None, None, None)] {{(pid=124317) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 12:39:24.184471 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-036f775f-2dae-4d6f-8b25-a81b43a2e831 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Flavor limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 12:39:24.184990 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-036f775f-2dae-4d6f-8b25-a81b43a2e831 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Image limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 12:39:24.185544 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-036f775f-2dae-4d6f-8b25-a81b43a2e831 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Flavor pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 12:39:24.186022 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-036f775f-2dae-4d6f-8b25-a81b43a2e831 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Image pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 12:39:24.186561 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-036f775f-2dae-4d6f-8b25-a81b43a2e831 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 12:39:24.196275 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-036f775f-2dae-4d6f-8b25-a81b43a2e831 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:24.196805 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-036f775f-2dae-4d6f-8b25-a81b43a2e831 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:24.197825 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-036f775f-2dae-4d6f-8b25-a81b43a2e831 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:24.198334 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-036f775f-2dae-4d6f-8b25-a81b43a2e831 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:24.215782 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-036f775f-2dae-4d6f-8b25-a81b43a2e831 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Getting quotas for project f18ffa75c23e4276a8b5b4fc3821fb87. Resources: {'cores', 'ram', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:39:24.220619 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-036f775f-2dae-4d6f-8b25-a81b43a2e831 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Getting quotas for user 2af4d4a69e9d4755bff61401f4349c78 and project f18ffa75c23e4276a8b5b4fc3821fb87. Resources: {'cores', 'ram', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:39:24.232353 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-036f775f-2dae-4d6f-8b25-a81b43a2e831 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Going to run 1 instances... {{(pid=124317) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 12:39:24.235783 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-036f775f-2dae-4d6f-8b25-a81b43a2e831 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70887696-f652-46b0-a5be-bfb400986078',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124317) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 12:39:24.285052 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-036f775f-2dae-4d6f-8b25-a81b43a2e831 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.718379 Jun 29 12:39:24.285788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 353/682] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 12:39:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 12:39:24.296354 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f7da4403-f61c-4e5a-b646-88dfe291bfd5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:24.297962 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f7da4403-f61c-4e5a-b646-88dfe291bfd5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:24.381171 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f7da4403-f61c-4e5a-b646-88dfe291bfd5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:24.390379 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f7da4403-f61c-4e5a-b646-88dfe291bfd5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338" status: 200 len: 1240 microversion: 2.1 time: 0.098450 Jun 29 12:39:24.391303 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 330/683] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:39:24 2022] GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 => generated 1240 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:39:24.464477 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-032b3585-d5b8-43e6-ab17-46eae291ab40 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:24.465424 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-032b3585-d5b8-43e6-ab17-46eae291ab40 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:24.473213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-032b3585-d5b8-43e6-ab17-46eae291ab40 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:24.473592 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-032b3585-d5b8-43e6-ab17-46eae291ab40 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:24.474368 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-032b3585-d5b8-43e6-ab17-46eae291ab40 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:24.475199 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-032b3585-d5b8-43e6-ab17-46eae291ab40 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:24.631341 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-032b3585-d5b8-43e6-ab17-46eae291ab40 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:24.644798 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-032b3585-d5b8-43e6-ab17-46eae291ab40 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:24.647134 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-032b3585-d5b8-43e6-ab17-46eae291ab40 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:24.648458 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-032b3585-d5b8-43e6-ab17-46eae291ab40 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1721 microversion: 2.20 time: 0.187859 Jun 29 12:39:24.649646 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 354/684] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:24 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:25.408961 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8fc64ba9-c744-4e9d-83b7-a799e0f249d2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:25.409575 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8fc64ba9-c744-4e9d-83b7-a799e0f249d2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:25.416773 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8fc64ba9-c744-4e9d-83b7-a799e0f249d2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:25.417232 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8fc64ba9-c744-4e9d-83b7-a799e0f249d2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:25.417997 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8fc64ba9-c744-4e9d-83b7-a799e0f249d2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:25.418457 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8fc64ba9-c744-4e9d-83b7-a799e0f249d2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:25.490445 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8fc64ba9-c744-4e9d-83b7-a799e0f249d2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:25.498807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8fc64ba9-c744-4e9d-83b7-a799e0f249d2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338" status: 200 len: 1244 microversion: 2.1 time: 0.094856 Jun 29 12:39:25.499638 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 331/685] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:39:25 2022] GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 => generated 1244 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:39:25.667805 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e39c986f-b5ab-4f44-b08f-b774fcee4b1c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:25.668680 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e39c986f-b5ab-4f44-b08f-b774fcee4b1c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:25.676324 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e39c986f-b5ab-4f44-b08f-b774fcee4b1c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:25.677141 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e39c986f-b5ab-4f44-b08f-b774fcee4b1c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:25.678184 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e39c986f-b5ab-4f44-b08f-b774fcee4b1c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:25.679044 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e39c986f-b5ab-4f44-b08f-b774fcee4b1c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:25.823201 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e39c986f-b5ab-4f44-b08f-b774fcee4b1c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:25.832181 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e39c986f-b5ab-4f44-b08f-b774fcee4b1c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:25.833710 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e39c986f-b5ab-4f44-b08f-b774fcee4b1c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:25.834967 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e39c986f-b5ab-4f44-b08f-b774fcee4b1c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1724 microversion: 2.20 time: 0.171081 Jun 29 12:39:25.835562 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 355/686] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:25 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 12:39:25.853912 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d3d65d40-5ddb-4354-8835-a3becbdeb6d1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a6f4318-c6f3-45e5-a803-9a4072eac07f"}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:39:25.855019 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d3d65d40-5ddb-4354-8835-a3becbdeb6d1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:25.861070 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d3d65d40-5ddb-4354-8835-a3becbdeb6d1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:25.861527 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d3d65d40-5ddb-4354-8835-a3becbdeb6d1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:25.862298 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d3d65d40-5ddb-4354-8835-a3becbdeb6d1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:25.862766 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d3d65d40-5ddb-4354-8835-a3becbdeb6d1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:26.185911 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d3d65d40-5ddb-4354-8835-a3becbdeb6d1 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "POST /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.335841 Jun 29 12:39:26.188856 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 332/687] 10.222.0.52 () {62 vars in 1363 bytes} [Wed Jun 29 12:39:25 2022] POST /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db/os-volume_attachments => generated 188 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 12:39:26.333841 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9b718100-dabf-4603-b116-114ce1fe84ab tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:26.334348 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-9b718100-dabf-4603-b116-114ce1fe84ab tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:26.340859 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9b718100-dabf-4603-b116-114ce1fe84ab tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:26.341537 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9b718100-dabf-4603-b116-114ce1fe84ab tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:26.342653 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9b718100-dabf-4603-b116-114ce1fe84ab tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:26.343293 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9b718100-dabf-4603-b116-114ce1fe84ab tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:26.516421 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-40ca1797-3a50-440a-8a2e-8cbdae433661 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:26.517037 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-40ca1797-3a50-440a-8a2e-8cbdae433661 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:26.525655 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-40ca1797-3a50-440a-8a2e-8cbdae433661 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:26.526002 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-40ca1797-3a50-440a-8a2e-8cbdae433661 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:26.526995 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-40ca1797-3a50-440a-8a2e-8cbdae433661 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:26.528770 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-40ca1797-3a50-440a-8a2e-8cbdae433661 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:26.650899 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-40ca1797-3a50-440a-8a2e-8cbdae433661 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:26.663298 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-40ca1797-3a50-440a-8a2e-8cbdae433661 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338" status: 200 len: 1298 microversion: 2.1 time: 0.151437 Jun 29 12:39:26.664096 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 333/688] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:39:26 2022] GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 => generated 1298 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:39:26.675961 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-9b718100-dabf-4603-b116-114ce1fe84ab tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db/os-volume_attachments/3a6f4318-c6f3-45e5-a803-9a4072eac07f" status: 202 len: 0 microversion: 2.20 time: 0.347761 Jun 29 12:39:26.680452 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-0359fb26-54d9-4ecc-8ceb-ad94b99aa38b req-dc286653-fb9c-449e-b0a9-f6eeb9d6e64d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6005eeb-de9c-4299-85da-6bf176fba2db", "name": "network-vif-unplugged", "status": "completed", "tag": "91513e0c-31ea-42a7-a298-8bcc2b5e8547"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:39:26.681388 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 356/689] 10.222.0.52 () {60 vars in 1456 bytes} [Wed Jun 29 12:39:26 2022] DELETE /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db/os-volume_attachments/3a6f4318-c6f3-45e5-a803-9a4072eac07f => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 29 12:39:26.709877 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-0359fb26-54d9-4ecc-8ceb-ad94b99aa38b req-dc286653-fb9c-449e-b0a9-f6eeb9d6e64d service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:26.710331 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-0359fb26-54d9-4ecc-8ceb-ad94b99aa38b req-dc286653-fb9c-449e-b0a9-f6eeb9d6e64d service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:26.729035 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.compute.server_external_events [req-0359fb26-54d9-4ecc-8ceb-ad94b99aa38b req-dc286653-fb9c-449e-b0a9-f6eeb9d6e64d service nova] Unable to find a host for instance b6005eeb-de9c-4299-85da-6bf176fba2db. Dropping event network-vif-unplugged {{(pid=124316) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 29 12:39:26.730107 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-0359fb26-54d9-4ecc-8ceb-ad94b99aa38b req-dc286653-fb9c-449e-b0a9-f6eeb9d6e64d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.065216 Jun 29 12:39:26.734900 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 334/690] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 70 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 29 12:39:26.760153 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-68ef6f80-60a4-40b1-a8f6-a96039592d3b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:39:26.760907 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-68ef6f80-60a4-40b1-a8f6-a96039592d3b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:26.768349 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-68ef6f80-60a4-40b1-a8f6-a96039592d3b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:26.768807 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-68ef6f80-60a4-40b1-a8f6-a96039592d3b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:26.769580 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-68ef6f80-60a4-40b1-a8f6-a96039592d3b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:26.770189 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-68ef6f80-60a4-40b1-a8f6-a96039592d3b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:26.877280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-68ef6f80-60a4-40b1-a8f6-a96039592d3b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "POST /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db/action" status: 202 len: 0 microversion: 2.20 time: 0.120677 Jun 29 12:39:26.878347 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 357/691] 10.222.0.52 () {62 vars in 1318 bytes} [Wed Jun 29 12:39:26 2022] POST /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 29 12:39:26.889866 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c696fda1-2ea2-42e2-992f-6823378b1c95 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:26.891638 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c696fda1-2ea2-42e2-992f-6823378b1c95 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:26.899682 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c696fda1-2ea2-42e2-992f-6823378b1c95 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:26.900372 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c696fda1-2ea2-42e2-992f-6823378b1c95 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:26.901266 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c696fda1-2ea2-42e2-992f-6823378b1c95 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:26.901796 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c696fda1-2ea2-42e2-992f-6823378b1c95 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:27.187168 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c696fda1-2ea2-42e2-992f-6823378b1c95 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:27.196825 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c696fda1-2ea2-42e2-992f-6823378b1c95 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:27.198478 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c696fda1-2ea2-42e2-992f-6823378b1c95 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:27.199959 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c696fda1-2ea2-42e2-992f-6823378b1c95 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1672 microversion: 2.20 time: 0.317198 Jun 29 12:39:27.200605 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 335/692] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:26 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1672 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:27.682148 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-33901f65-db74-47f8-9645-f355765fb652 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:27.683067 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-33901f65-db74-47f8-9645-f355765fb652 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:27.692934 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-33901f65-db74-47f8-9645-f355765fb652 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:27.693381 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-33901f65-db74-47f8-9645-f355765fb652 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:27.695329 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-33901f65-db74-47f8-9645-f355765fb652 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:27.695767 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-33901f65-db74-47f8-9645-f355765fb652 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:27.864924 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-33901f65-db74-47f8-9645-f355765fb652 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:27.872967 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-33901f65-db74-47f8-9645-f355765fb652 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338" status: 200 len: 1365 microversion: 2.1 time: 0.195776 Jun 29 12:39:27.873761 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 358/693] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:39:27 2022] GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:39:28.220018 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2f2d67c0-0db6-487f-b7b1-c96ecc8ba0ce tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:28.222608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2f2d67c0-0db6-487f-b7b1-c96ecc8ba0ce tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:28.232109 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2f2d67c0-0db6-487f-b7b1-c96ecc8ba0ce tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:28.234121 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2f2d67c0-0db6-487f-b7b1-c96ecc8ba0ce tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:28.236415 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2f2d67c0-0db6-487f-b7b1-c96ecc8ba0ce tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:28.238538 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2f2d67c0-0db6-487f-b7b1-c96ecc8ba0ce tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:28.372879 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-08ccdaf9-3eb6-4c53-b2a0-e02d41b5cac8 req-cbbc528e-4cad-4158-bbe2-2f5a12b4c9e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d363d4d7-f546-4939-9ac6-bd4eb1118338", "tag": "c149decc-6a28-4e86-8dc3-2be54897e82e"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:39:28.386374 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-08ccdaf9-3eb6-4c53-b2a0-e02d41b5cac8 req-cbbc528e-4cad-4158-bbe2-2f5a12b4c9e9 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:28.387123 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-08ccdaf9-3eb6-4c53-b2a0-e02d41b5cac8 req-cbbc528e-4cad-4158-bbe2-2f5a12b4c9e9 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:28.399846 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-08ccdaf9-3eb6-4c53-b2a0-e02d41b5cac8 req-cbbc528e-4cad-4158-bbe2-2f5a12b4c9e9 service nova] Creating event network-changed:c149decc-6a28-4e86-8dc3-2be54897e82e for instance d363d4d7-f546-4939-9ac6-bd4eb1118338 on hv-cinder-81268 Jun 29 12:39:28.405283 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-08ccdaf9-3eb6-4c53-b2a0-e02d41b5cac8 req-cbbc528e-4cad-4158-bbe2-2f5a12b4c9e9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036520 Jun 29 12:39:28.406936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 359/694] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:39:28.652649 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2f2d67c0-0db6-487f-b7b1-c96ecc8ba0ce tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:28.661550 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2f2d67c0-0db6-487f-b7b1-c96ecc8ba0ce tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:28.663069 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-2f2d67c0-0db6-487f-b7b1-c96ecc8ba0ce tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:28.664826 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2f2d67c0-0db6-487f-b7b1-c96ecc8ba0ce tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1730 microversion: 2.20 time: 0.450156 Jun 29 12:39:28.665375 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 336/695] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:28 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1730 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:28.893384 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-32ebdf72-884b-44c8-bd95-43f42cad13e6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:28.894085 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-32ebdf72-884b-44c8-bd95-43f42cad13e6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:28.900700 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-32ebdf72-884b-44c8-bd95-43f42cad13e6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:28.901356 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-32ebdf72-884b-44c8-bd95-43f42cad13e6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:28.902327 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-32ebdf72-884b-44c8-bd95-43f42cad13e6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:28.902782 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-32ebdf72-884b-44c8-bd95-43f42cad13e6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:29.075626 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-32ebdf72-884b-44c8-bd95-43f42cad13e6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:29.085553 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-32ebdf72-884b-44c8-bd95-43f42cad13e6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338" status: 200 len: 1365 microversion: 2.1 time: 0.197612 Jun 29 12:39:29.086351 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 360/696] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:39:28 2022] GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:39:29.683501 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-058e785c-9e21-4542-8b7a-cfc19c042fc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:29.684118 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-058e785c-9e21-4542-8b7a-cfc19c042fc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:29.694679 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-058e785c-9e21-4542-8b7a-cfc19c042fc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:29.695133 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-058e785c-9e21-4542-8b7a-cfc19c042fc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:29.695907 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-058e785c-9e21-4542-8b7a-cfc19c042fc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:29.696378 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-058e785c-9e21-4542-8b7a-cfc19c042fc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:29.833346 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-058e785c-9e21-4542-8b7a-cfc19c042fc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:29.841220 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-058e785c-9e21-4542-8b7a-cfc19c042fc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:29.842799 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-058e785c-9e21-4542-8b7a-cfc19c042fc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:29.843984 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-058e785c-9e21-4542-8b7a-cfc19c042fc0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1730 microversion: 2.20 time: 0.164386 Jun 29 12:39:29.844546 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 337/697] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:29 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:30.104423 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-7d68873e-91b5-4100-8c65-3ef4a7ba5046 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:30.105166 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-7d68873e-91b5-4100-8c65-3ef4a7ba5046 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:30.113782 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7d68873e-91b5-4100-8c65-3ef4a7ba5046 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:30.114224 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7d68873e-91b5-4100-8c65-3ef4a7ba5046 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:30.115688 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7d68873e-91b5-4100-8c65-3ef4a7ba5046 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:30.116125 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7d68873e-91b5-4100-8c65-3ef4a7ba5046 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:30.285142 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7d68873e-91b5-4100-8c65-3ef4a7ba5046 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:30.296971 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-7d68873e-91b5-4100-8c65-3ef4a7ba5046 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338" status: 200 len: 1365 microversion: 2.1 time: 0.197499 Jun 29 12:39:30.305405 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 361/698] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:39:30 2022] GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:39:30.863648 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9cb0c60e-4c11-41be-843d-64c057cd992e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:30.865055 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-9cb0c60e-4c11-41be-843d-64c057cd992e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:30.878518 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9cb0c60e-4c11-41be-843d-64c057cd992e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:30.879015 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9cb0c60e-4c11-41be-843d-64c057cd992e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:30.879792 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9cb0c60e-4c11-41be-843d-64c057cd992e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:30.880226 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9cb0c60e-4c11-41be-843d-64c057cd992e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:31.045435 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9cb0c60e-4c11-41be-843d-64c057cd992e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:31.053579 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9cb0c60e-4c11-41be-843d-64c057cd992e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:31.055125 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9cb0c60e-4c11-41be-843d-64c057cd992e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:31.056275 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9cb0c60e-4c11-41be-843d-64c057cd992e tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1730 microversion: 2.20 time: 0.198815 Jun 29 12:39:31.056827 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 338/699] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:30 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1730 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:31.316263 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-610a1935-acd6-4485-9476-f947b2e72495 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:31.316934 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-610a1935-acd6-4485-9476-f947b2e72495 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:31.323561 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-610a1935-acd6-4485-9476-f947b2e72495 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:31.324012 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-610a1935-acd6-4485-9476-f947b2e72495 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:31.324783 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-610a1935-acd6-4485-9476-f947b2e72495 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:31.325223 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-610a1935-acd6-4485-9476-f947b2e72495 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:31.330463 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:39:31.480454 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-610a1935-acd6-4485-9476-f947b2e72495 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:31.488484 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-610a1935-acd6-4485-9476-f947b2e72495 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338" status: 200 len: 1365 microversion: 2.1 time: 0.177095 Jun 29 12:39:31.489045 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 362/700] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:39:31 2022] GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:39:32.075304 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8f919903-6c7a-4ca7-a244-93be3d9d6ce7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:32.076027 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8f919903-6c7a-4ca7-a244-93be3d9d6ce7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:32.083387 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8f919903-6c7a-4ca7-a244-93be3d9d6ce7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:32.083842 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8f919903-6c7a-4ca7-a244-93be3d9d6ce7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:32.084623 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8f919903-6c7a-4ca7-a244-93be3d9d6ce7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:32.085064 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8f919903-6c7a-4ca7-a244-93be3d9d6ce7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:32.251621 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8f919903-6c7a-4ca7-a244-93be3d9d6ce7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:32.260049 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8f919903-6c7a-4ca7-a244-93be3d9d6ce7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:32.261550 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8f919903-6c7a-4ca7-a244-93be3d9d6ce7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:32.262988 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8f919903-6c7a-4ca7-a244-93be3d9d6ce7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1730 microversion: 2.20 time: 0.191695 Jun 29 12:39:32.263858 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 339/701] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:32 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:32.505661 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e89f7ec4-4b20-4e63-a9b4-9a52331ddd5c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:32.506281 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e89f7ec4-4b20-4e63-a9b4-9a52331ddd5c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:32.516629 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e89f7ec4-4b20-4e63-a9b4-9a52331ddd5c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:32.522404 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e89f7ec4-4b20-4e63-a9b4-9a52331ddd5c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:32.523298 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e89f7ec4-4b20-4e63-a9b4-9a52331ddd5c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:32.523750 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e89f7ec4-4b20-4e63-a9b4-9a52331ddd5c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:32.758094 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e89f7ec4-4b20-4e63-a9b4-9a52331ddd5c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:32.767260 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e89f7ec4-4b20-4e63-a9b4-9a52331ddd5c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338" status: 200 len: 1365 microversion: 2.1 time: 0.265745 Jun 29 12:39:32.768083 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 363/702] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:39:32 2022] GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 => generated 1365 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:39:33.282986 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-229a2dc2-bd67-4685-8c0e-f2d3e735e2e4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:33.283583 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-229a2dc2-bd67-4685-8c0e-f2d3e735e2e4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:33.290325 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-229a2dc2-bd67-4685-8c0e-f2d3e735e2e4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:33.291069 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-229a2dc2-bd67-4685-8c0e-f2d3e735e2e4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:33.292029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-229a2dc2-bd67-4685-8c0e-f2d3e735e2e4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:33.292652 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-229a2dc2-bd67-4685-8c0e-f2d3e735e2e4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:33.430521 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-229a2dc2-bd67-4685-8c0e-f2d3e735e2e4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:33.440833 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-229a2dc2-bd67-4685-8c0e-f2d3e735e2e4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:33.442672 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-229a2dc2-bd67-4685-8c0e-f2d3e735e2e4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:33.444028 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-229a2dc2-bd67-4685-8c0e-f2d3e735e2e4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1730 microversion: 2.20 time: 0.165866 Jun 29 12:39:33.455019 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 340/703] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:33 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:33.785423 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-bc721e8b-0c49-4126-9c4d-8290c77cacfc tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:33.786184 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-bc721e8b-0c49-4126-9c4d-8290c77cacfc tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:33.795471 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bc721e8b-0c49-4126-9c4d-8290c77cacfc tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:33.797425 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bc721e8b-0c49-4126-9c4d-8290c77cacfc tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:33.798657 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bc721e8b-0c49-4126-9c4d-8290c77cacfc tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:33.799513 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bc721e8b-0c49-4126-9c4d-8290c77cacfc tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:33.983816 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-bc721e8b-0c49-4126-9c4d-8290c77cacfc tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:33.992500 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-bc721e8b-0c49-4126-9c4d-8290c77cacfc tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338" status: 200 len: 1365 microversion: 2.1 time: 0.210988 Jun 29 12:39:33.993081 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 364/704] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:39:33 2022] GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:39:34.462385 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4264d0e1-1bf8-40c5-a80b-e2aae6551ed7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:34.463059 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4264d0e1-1bf8-40c5-a80b-e2aae6551ed7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:34.466737 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=6 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:39:34.475751 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4264d0e1-1bf8-40c5-a80b-e2aae6551ed7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:34.476501 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4264d0e1-1bf8-40c5-a80b-e2aae6551ed7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:34.477293 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4264d0e1-1bf8-40c5-a80b-e2aae6551ed7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:34.477737 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4264d0e1-1bf8-40c5-a80b-e2aae6551ed7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:34.694121 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4264d0e1-1bf8-40c5-a80b-e2aae6551ed7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:34.706350 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4264d0e1-1bf8-40c5-a80b-e2aae6551ed7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:34.708464 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4264d0e1-1bf8-40c5-a80b-e2aae6551ed7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:34.710087 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4264d0e1-1bf8-40c5-a80b-e2aae6551ed7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1730 microversion: 2.20 time: 0.252059 Jun 29 12:39:34.722300 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 341/705] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:34 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1730 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:34.754623 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-83cf8591-62e5-4380-a5b0-44602355836b req-50e0883a-1296-4386-94f8-b97b7aebf8e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d363d4d7-f546-4939-9ac6-bd4eb1118338", "name": "network-vif-plugged", "status": "completed", "tag": "c149decc-6a28-4e86-8dc3-2be54897e82e"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:39:34.759260 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:39:34.760375 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=6 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:39:34.767987 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-83cf8591-62e5-4380-a5b0-44602355836b req-50e0883a-1296-4386-94f8-b97b7aebf8e6 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:34.768602 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-83cf8591-62e5-4380-a5b0-44602355836b req-50e0883a-1296-4386-94f8-b97b7aebf8e6 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:34.782649 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-83cf8591-62e5-4380-a5b0-44602355836b req-50e0883a-1296-4386-94f8-b97b7aebf8e6 service nova] Creating event network-vif-plugged:c149decc-6a28-4e86-8dc3-2be54897e82e for instance d363d4d7-f546-4939-9ac6-bd4eb1118338 on hv-cinder-81268 Jun 29 12:39:34.788413 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-83cf8591-62e5-4380-a5b0-44602355836b req-50e0883a-1296-4386-94f8-b97b7aebf8e6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037596 Jun 29 12:39:34.789560 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 365/706] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:39:35.011381 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a335d9c3-0033-42f9-8a4d-ca8d77d18bf4 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:35.012259 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a335d9c3-0033-42f9-8a4d-ca8d77d18bf4 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:35.018703 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a335d9c3-0033-42f9-8a4d-ca8d77d18bf4 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:35.019160 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a335d9c3-0033-42f9-8a4d-ca8d77d18bf4 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:35.019972 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a335d9c3-0033-42f9-8a4d-ca8d77d18bf4 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:35.030272 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a335d9c3-0033-42f9-8a4d-ca8d77d18bf4 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:35.182109 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-a335d9c3-0033-42f9-8a4d-ca8d77d18bf4 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:35.185949 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:39:35.190736 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a335d9c3-0033-42f9-8a4d-ca8d77d18bf4 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338" status: 200 len: 1365 microversion: 2.1 time: 0.183212 Jun 29 12:39:35.194698 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 342/707] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:39:35 2022] GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:39:35.730617 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-14b73293-8a95-4b00-8da6-15a761525c41 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:35.731381 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-14b73293-8a95-4b00-8da6-15a761525c41 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:35.737610 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-14b73293-8a95-4b00-8da6-15a761525c41 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:35.738053 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-14b73293-8a95-4b00-8da6-15a761525c41 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:35.738833 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-14b73293-8a95-4b00-8da6-15a761525c41 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:35.739264 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-14b73293-8a95-4b00-8da6-15a761525c41 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:35.914327 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-14b73293-8a95-4b00-8da6-15a761525c41 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:35.923038 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-14b73293-8a95-4b00-8da6-15a761525c41 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:35.924516 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-14b73293-8a95-4b00-8da6-15a761525c41 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:35.925678 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-14b73293-8a95-4b00-8da6-15a761525c41 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1730 microversion: 2.20 time: 0.200182 Jun 29 12:39:35.926225 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 366/708] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:35 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:36.211908 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f2d8c13b-8227-4a1c-bf8f-de29afe1af90 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:36.212717 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f2d8c13b-8227-4a1c-bf8f-de29afe1af90 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:36.221960 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f2d8c13b-8227-4a1c-bf8f-de29afe1af90 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:36.222762 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f2d8c13b-8227-4a1c-bf8f-de29afe1af90 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:36.223799 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f2d8c13b-8227-4a1c-bf8f-de29afe1af90 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:36.224494 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f2d8c13b-8227-4a1c-bf8f-de29afe1af90 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:36.367100 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f2d8c13b-8227-4a1c-bf8f-de29afe1af90 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:36.375927 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f2d8c13b-8227-4a1c-bf8f-de29afe1af90 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338" status: 200 len: 1365 microversion: 2.1 time: 0.168372 Jun 29 12:39:36.377111 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 343/709] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:39:36 2022] GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:39:36.944226 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0a02b8b1-09e4-4ed6-8266-8183156b2645 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:36.944832 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0a02b8b1-09e4-4ed6-8266-8183156b2645 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:36.951303 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0a02b8b1-09e4-4ed6-8266-8183156b2645 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:36.951749 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0a02b8b1-09e4-4ed6-8266-8183156b2645 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:36.953002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0a02b8b1-09e4-4ed6-8266-8183156b2645 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:36.953508 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0a02b8b1-09e4-4ed6-8266-8183156b2645 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:37.103842 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0a02b8b1-09e4-4ed6-8266-8183156b2645 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:37.119015 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0a02b8b1-09e4-4ed6-8266-8183156b2645 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:37.120524 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0a02b8b1-09e4-4ed6-8266-8183156b2645 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:37.121705 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0a02b8b1-09e4-4ed6-8266-8183156b2645 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1730 microversion: 2.20 time: 0.181411 Jun 29 12:39:37.132961 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 367/710] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:36 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:37.394627 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-558f68af-3190-4747-920f-985a5f04b9c5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:37.395599 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-558f68af-3190-4747-920f-985a5f04b9c5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:37.402132 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-558f68af-3190-4747-920f-985a5f04b9c5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:37.402622 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-558f68af-3190-4747-920f-985a5f04b9c5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:37.403385 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-558f68af-3190-4747-920f-985a5f04b9c5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:37.403822 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-558f68af-3190-4747-920f-985a5f04b9c5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:37.580772 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-558f68af-3190-4747-920f-985a5f04b9c5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:37.596126 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-558f68af-3190-4747-920f-985a5f04b9c5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338" status: 200 len: 1365 microversion: 2.1 time: 0.205407 Jun 29 12:39:37.597029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 344/711] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:39:37 2022] GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 => generated 1365 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:39:38.141245 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-be63a582-8eff-4ff5-9c17-e977f9af3b1d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:38.142983 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-be63a582-8eff-4ff5-9c17-e977f9af3b1d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:38.150803 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-be63a582-8eff-4ff5-9c17-e977f9af3b1d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:38.151627 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-be63a582-8eff-4ff5-9c17-e977f9af3b1d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:38.152849 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-be63a582-8eff-4ff5-9c17-e977f9af3b1d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:38.153832 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-be63a582-8eff-4ff5-9c17-e977f9af3b1d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:38.312095 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-be63a582-8eff-4ff5-9c17-e977f9af3b1d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:38.320858 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-be63a582-8eff-4ff5-9c17-e977f9af3b1d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:38.322356 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-be63a582-8eff-4ff5-9c17-e977f9af3b1d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:38.324826 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-be63a582-8eff-4ff5-9c17-e977f9af3b1d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1730 microversion: 2.20 time: 0.188416 Jun 29 12:39:38.325392 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 368/712] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:38 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:38.614938 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-69f47d2e-3920-4493-a455-4d70d6bbd632 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:38.615550 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-69f47d2e-3920-4493-a455-4d70d6bbd632 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:38.621960 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-69f47d2e-3920-4493-a455-4d70d6bbd632 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:38.622410 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-69f47d2e-3920-4493-a455-4d70d6bbd632 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:38.623205 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-69f47d2e-3920-4493-a455-4d70d6bbd632 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:38.623644 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-69f47d2e-3920-4493-a455-4d70d6bbd632 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:38.762390 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-69f47d2e-3920-4493-a455-4d70d6bbd632 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:38.781155 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-69f47d2e-3920-4493-a455-4d70d6bbd632 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338" status: 200 len: 1365 microversion: 2.1 time: 0.169629 Jun 29 12:39:38.781839 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 345/713] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:39:38 2022] GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:39:39.344306 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b93be685-af43-4e70-bb9f-2bef89981e7b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:39.344727 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b93be685-af43-4e70-bb9f-2bef89981e7b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:39.351161 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b93be685-af43-4e70-bb9f-2bef89981e7b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:39.351604 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b93be685-af43-4e70-bb9f-2bef89981e7b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:39.352360 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b93be685-af43-4e70-bb9f-2bef89981e7b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:39.352795 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b93be685-af43-4e70-bb9f-2bef89981e7b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:39.493192 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b93be685-af43-4e70-bb9f-2bef89981e7b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:39.501057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b93be685-af43-4e70-bb9f-2bef89981e7b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:39.502715 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b93be685-af43-4e70-bb9f-2bef89981e7b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:39.503864 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b93be685-af43-4e70-bb9f-2bef89981e7b tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1730 microversion: 2.20 time: 0.164110 Jun 29 12:39:39.504408 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 369/714] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:39 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:39.798567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-36373668-0d06-4852-b3bb-b21b9deb6744 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:39.799177 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-36373668-0d06-4852-b3bb-b21b9deb6744 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:39.805611 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-36373668-0d06-4852-b3bb-b21b9deb6744 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:39.806055 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-36373668-0d06-4852-b3bb-b21b9deb6744 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:39.806831 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-36373668-0d06-4852-b3bb-b21b9deb6744 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:39.807264 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-36373668-0d06-4852-b3bb-b21b9deb6744 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:40.190617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-36373668-0d06-4852-b3bb-b21b9deb6744 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:40.198018 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-36373668-0d06-4852-b3bb-b21b9deb6744 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338" status: 200 len: 1365 microversion: 2.1 time: 0.403245 Jun 29 12:39:40.198575 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 346/715] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:39:39 2022] GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 => generated 1365 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:39:40.522087 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-70af6d46-7053-44f4-8d3f-c23fa174d45d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:40.522712 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-70af6d46-7053-44f4-8d3f-c23fa174d45d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:40.529005 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-70af6d46-7053-44f4-8d3f-c23fa174d45d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:40.529472 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-70af6d46-7053-44f4-8d3f-c23fa174d45d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:40.530213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-70af6d46-7053-44f4-8d3f-c23fa174d45d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:40.531291 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-70af6d46-7053-44f4-8d3f-c23fa174d45d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:40.661999 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-70af6d46-7053-44f4-8d3f-c23fa174d45d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:40.669813 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-70af6d46-7053-44f4-8d3f-c23fa174d45d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:40.671962 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-70af6d46-7053-44f4-8d3f-c23fa174d45d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:40.673122 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-70af6d46-7053-44f4-8d3f-c23fa174d45d tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1730 microversion: 2.20 time: 0.155193 Jun 29 12:39:40.673680 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 370/716] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:40 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:41.214945 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f5551bbf-3ec6-4669-b4bf-e7337ea8e832 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:41.215559 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f5551bbf-3ec6-4669-b4bf-e7337ea8e832 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:41.222821 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f5551bbf-3ec6-4669-b4bf-e7337ea8e832 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:41.223291 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f5551bbf-3ec6-4669-b4bf-e7337ea8e832 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:41.224063 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f5551bbf-3ec6-4669-b4bf-e7337ea8e832 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:41.224504 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f5551bbf-3ec6-4669-b4bf-e7337ea8e832 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:41.407500 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f5551bbf-3ec6-4669-b4bf-e7337ea8e832 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:41.415089 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f5551bbf-3ec6-4669-b4bf-e7337ea8e832 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338" status: 200 len: 1365 microversion: 2.1 time: 0.203979 Jun 29 12:39:41.415885 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 347/717] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:39:41 2022] GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:39:41.691078 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d5dcb8e2-d1bf-4bbe-b8da-acf20bdeffa0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:41.691670 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d5dcb8e2-d1bf-4bbe-b8da-acf20bdeffa0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:41.698044 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d5dcb8e2-d1bf-4bbe-b8da-acf20bdeffa0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:41.698520 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d5dcb8e2-d1bf-4bbe-b8da-acf20bdeffa0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:41.699273 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d5dcb8e2-d1bf-4bbe-b8da-acf20bdeffa0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:41.699706 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d5dcb8e2-d1bf-4bbe-b8da-acf20bdeffa0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:41.826007 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d5dcb8e2-d1bf-4bbe-b8da-acf20bdeffa0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:41.833942 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d5dcb8e2-d1bf-4bbe-b8da-acf20bdeffa0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:41.835493 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d5dcb8e2-d1bf-4bbe-b8da-acf20bdeffa0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:41.836625 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d5dcb8e2-d1bf-4bbe-b8da-acf20bdeffa0 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1730 microversion: 2.20 time: 0.149632 Jun 29 12:39:41.837176 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 371/718] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:41 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:42.433869 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f05508b7-0f25-4752-88a2-023b3476283f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:42.434542 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f05508b7-0f25-4752-88a2-023b3476283f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:42.442028 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f05508b7-0f25-4752-88a2-023b3476283f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:42.442512 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f05508b7-0f25-4752-88a2-023b3476283f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:42.443276 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f05508b7-0f25-4752-88a2-023b3476283f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:42.443714 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f05508b7-0f25-4752-88a2-023b3476283f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:42.569772 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f05508b7-0f25-4752-88a2-023b3476283f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:42.577375 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f05508b7-0f25-4752-88a2-023b3476283f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338" status: 200 len: 1365 microversion: 2.1 time: 0.147358 Jun 29 12:39:42.578454 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 348/719] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:39:42 2022] GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:39:42.855828 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4d203c75-ff81-4217-a272-75a794b836d3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:42.856549 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4d203c75-ff81-4217-a272-75a794b836d3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:42.863527 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4d203c75-ff81-4217-a272-75a794b836d3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:42.863971 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4d203c75-ff81-4217-a272-75a794b836d3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:42.864723 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4d203c75-ff81-4217-a272-75a794b836d3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:42.865154 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4d203c75-ff81-4217-a272-75a794b836d3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:42.997522 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4d203c75-ff81-4217-a272-75a794b836d3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:43.006171 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4d203c75-ff81-4217-a272-75a794b836d3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:43.007682 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4d203c75-ff81-4217-a272-75a794b836d3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:43.008824 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4d203c75-ff81-4217-a272-75a794b836d3 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1730 microversion: 2.20 time: 0.157005 Jun 29 12:39:43.009372 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 372/720] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:42 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:43.594577 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-168fc12d-6802-4885-96e3-fd4739a9cf5b tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:43.595187 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-168fc12d-6802-4885-96e3-fd4739a9cf5b tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:43.601624 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-168fc12d-6802-4885-96e3-fd4739a9cf5b tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:43.602076 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-168fc12d-6802-4885-96e3-fd4739a9cf5b tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:43.602860 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-168fc12d-6802-4885-96e3-fd4739a9cf5b tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:43.603299 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-168fc12d-6802-4885-96e3-fd4739a9cf5b tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:43.732499 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-168fc12d-6802-4885-96e3-fd4739a9cf5b tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:43.740588 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-168fc12d-6802-4885-96e3-fd4739a9cf5b tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338" status: 200 len: 1365 microversion: 2.1 time: 0.149901 Jun 29 12:39:43.741153 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 349/721] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:39:43 2022] GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:39:44.027243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-2d3b7ca6-8f49-4671-8a97-30f9dbb4da06 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:44.027854 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-2d3b7ca6-8f49-4671-8a97-30f9dbb4da06 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:44.034972 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2d3b7ca6-8f49-4671-8a97-30f9dbb4da06 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:44.035420 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2d3b7ca6-8f49-4671-8a97-30f9dbb4da06 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:44.036203 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2d3b7ca6-8f49-4671-8a97-30f9dbb4da06 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:44.036638 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2d3b7ca6-8f49-4671-8a97-30f9dbb4da06 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:44.167820 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2d3b7ca6-8f49-4671-8a97-30f9dbb4da06 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:44.176264 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2d3b7ca6-8f49-4671-8a97-30f9dbb4da06 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:44.177748 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-2d3b7ca6-8f49-4671-8a97-30f9dbb4da06 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:44.178916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-2d3b7ca6-8f49-4671-8a97-30f9dbb4da06 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1730 microversion: 2.20 time: 0.155573 Jun 29 12:39:44.179472 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 373/722] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:44 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:44.757688 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-26b6076d-ce84-48d6-9304-7bea26e39723 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:44.758653 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-26b6076d-ce84-48d6-9304-7bea26e39723 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:44.765649 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-26b6076d-ce84-48d6-9304-7bea26e39723 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:44.766136 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-26b6076d-ce84-48d6-9304-7bea26e39723 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:44.766941 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-26b6076d-ce84-48d6-9304-7bea26e39723 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:44.767366 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-26b6076d-ce84-48d6-9304-7bea26e39723 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:44.898526 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-26b6076d-ce84-48d6-9304-7bea26e39723 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:44.905975 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-26b6076d-ce84-48d6-9304-7bea26e39723 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338" status: 200 len: 1365 microversion: 2.1 time: 0.152850 Jun 29 12:39:44.906548 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 350/723] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:39:44 2022] GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:39:45.197383 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-67435d8c-f9f0-4b50-86af-9a17bdc35c21 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:45.198890 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-67435d8c-f9f0-4b50-86af-9a17bdc35c21 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:45.205715 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-67435d8c-f9f0-4b50-86af-9a17bdc35c21 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:45.206166 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-67435d8c-f9f0-4b50-86af-9a17bdc35c21 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:45.206960 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-67435d8c-f9f0-4b50-86af-9a17bdc35c21 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:45.207404 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-67435d8c-f9f0-4b50-86af-9a17bdc35c21 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:45.334513 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-67435d8c-f9f0-4b50-86af-9a17bdc35c21 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:45.342151 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-67435d8c-f9f0-4b50-86af-9a17bdc35c21 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:45.343795 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-67435d8c-f9f0-4b50-86af-9a17bdc35c21 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:45.344930 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-67435d8c-f9f0-4b50-86af-9a17bdc35c21 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1730 microversion: 2.20 time: 0.151688 Jun 29 12:39:45.345681 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 374/724] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:45 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:45.922370 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6cf1a9a9-1086-4041-80b4-27cfa92f6085 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:45.923062 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6cf1a9a9-1086-4041-80b4-27cfa92f6085 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:45.929462 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6cf1a9a9-1086-4041-80b4-27cfa92f6085 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:45.929914 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6cf1a9a9-1086-4041-80b4-27cfa92f6085 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:45.930695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6cf1a9a9-1086-4041-80b4-27cfa92f6085 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:45.931132 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6cf1a9a9-1086-4041-80b4-27cfa92f6085 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:46.057922 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6cf1a9a9-1086-4041-80b4-27cfa92f6085 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:46.065224 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6cf1a9a9-1086-4041-80b4-27cfa92f6085 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338" status: 200 len: 1554 microversion: 2.1 time: 0.147306 Jun 29 12:39:46.065794 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 351/725] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:39:45 2022] GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 => generated 1554 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:39:46.081571 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-aa47fd27-290c-4d1c-96ae-a97e86e20bab tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:46.082062 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-aa47fd27-290c-4d1c-96ae-a97e86e20bab tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:46.087986 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aa47fd27-290c-4d1c-96ae-a97e86e20bab tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:46.088430 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aa47fd27-290c-4d1c-96ae-a97e86e20bab tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:46.089178 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aa47fd27-290c-4d1c-96ae-a97e86e20bab tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:46.089616 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aa47fd27-290c-4d1c-96ae-a97e86e20bab tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:46.167351 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-aa47fd27-290c-4d1c-96ae-a97e86e20bab tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090095 Jun 29 12:39:46.167949 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 375/726] 10.222.0.52 () {58 vars in 1274 bytes} [Wed Jun 29 12:39:46 2022] GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:39:46.364086 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f293946f-c116-48e2-8de9-e1e3fff0bcaf tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:46.364728 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f293946f-c116-48e2-8de9-e1e3fff0bcaf tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:46.370737 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f293946f-c116-48e2-8de9-e1e3fff0bcaf tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:46.371186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f293946f-c116-48e2-8de9-e1e3fff0bcaf tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:46.371951 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f293946f-c116-48e2-8de9-e1e3fff0bcaf tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:46.372388 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f293946f-c116-48e2-8de9-e1e3fff0bcaf tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:46.507356 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f293946f-c116-48e2-8de9-e1e3fff0bcaf tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:46.515354 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f293946f-c116-48e2-8de9-e1e3fff0bcaf tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:46.516954 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f293946f-c116-48e2-8de9-e1e3fff0bcaf tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:46.518113 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f293946f-c116-48e2-8de9-e1e3fff0bcaf tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1730 microversion: 2.20 time: 0.158269 Jun 29 12:39:46.518706 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 352/727] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:46 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:47.089928 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-e5fb41a4-0600-435f-96b7-4380e84d1c76 req-45192a06-824d-4c18-920d-719e79597eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6005eeb-de9c-4299-85da-6bf176fba2db", "name": "network-vif-plugged", "status": "completed", "tag": "91513e0c-31ea-42a7-a298-8bcc2b5e8547"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:39:47.098954 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-e5fb41a4-0600-435f-96b7-4380e84d1c76 req-45192a06-824d-4c18-920d-719e79597eb8 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:47.099397 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-e5fb41a4-0600-435f-96b7-4380e84d1c76 req-45192a06-824d-4c18-920d-719e79597eb8 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:47.111396 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-e5fb41a4-0600-435f-96b7-4380e84d1c76 req-45192a06-824d-4c18-920d-719e79597eb8 service nova] Creating event network-vif-plugged:91513e0c-31ea-42a7-a298-8bcc2b5e8547 for instance b6005eeb-de9c-4299-85da-6bf176fba2db on hv-cinder-81268 Jun 29 12:39:47.116702 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-e5fb41a4-0600-435f-96b7-4380e84d1c76 req-45192a06-824d-4c18-920d-719e79597eb8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031052 Jun 29 12:39:47.117293 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 376/728] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:39:47.457807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-a14e5bf5-78df-4793-bbe6-bc74bdd21ed6 req-514ca08a-56fb-4bcf-b1d8-a33c741e90df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d363d4d7-f546-4939-9ac6-bd4eb1118338", "tag": "c149decc-6a28-4e86-8dc3-2be54897e82e"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:39:47.465856 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-a14e5bf5-78df-4793-bbe6-bc74bdd21ed6 req-514ca08a-56fb-4bcf-b1d8-a33c741e90df service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:47.466326 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-a14e5bf5-78df-4793-bbe6-bc74bdd21ed6 req-514ca08a-56fb-4bcf-b1d8-a33c741e90df service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:47.478026 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-a14e5bf5-78df-4793-bbe6-bc74bdd21ed6 req-514ca08a-56fb-4bcf-b1d8-a33c741e90df service nova] Creating event network-changed:c149decc-6a28-4e86-8dc3-2be54897e82e for instance d363d4d7-f546-4939-9ac6-bd4eb1118338 on hv-cinder-81268 Jun 29 12:39:47.483052 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-a14e5bf5-78df-4793-bbe6-bc74bdd21ed6 req-514ca08a-56fb-4bcf-b1d8-a33c741e90df service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153543 Jun 29 12:39:47.483790 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 353/729] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:39:47.538174 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a17f8367-02ce-4865-b622-0b63cf6ccb05 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:47.538891 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a17f8367-02ce-4865-b622-0b63cf6ccb05 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:47.544999 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a17f8367-02ce-4865-b622-0b63cf6ccb05 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:47.545440 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a17f8367-02ce-4865-b622-0b63cf6ccb05 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:47.546546 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a17f8367-02ce-4865-b622-0b63cf6ccb05 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:47.546982 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a17f8367-02ce-4865-b622-0b63cf6ccb05 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:47.683695 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a17f8367-02ce-4865-b622-0b63cf6ccb05 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:47.692757 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a17f8367-02ce-4865-b622-0b63cf6ccb05 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:47.694247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-a17f8367-02ce-4865-b622-0b63cf6ccb05 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:47.695425 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a17f8367-02ce-4865-b622-0b63cf6ccb05 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1730 microversion: 2.20 time: 0.161580 Jun 29 12:39:47.695980 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 377/730] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:47 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:48.715738 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e474892b-5c34-4922-9d12-e9cf29658a84 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:48.716523 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e474892b-5c34-4922-9d12-e9cf29658a84 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:48.724410 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e474892b-5c34-4922-9d12-e9cf29658a84 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:48.725085 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e474892b-5c34-4922-9d12-e9cf29658a84 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:48.726168 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e474892b-5c34-4922-9d12-e9cf29658a84 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:48.726795 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e474892b-5c34-4922-9d12-e9cf29658a84 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:49.026006 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e474892b-5c34-4922-9d12-e9cf29658a84 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:49.035391 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e474892b-5c34-4922-9d12-e9cf29658a84 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:49.036883 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e474892b-5c34-4922-9d12-e9cf29658a84 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:49.038137 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e474892b-5c34-4922-9d12-e9cf29658a84 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1730 microversion: 2.20 time: 0.327013 Jun 29 12:39:49.038901 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 354/731] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:48 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1730 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:50.056357 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4395d829-89e0-40b2-a8c7-bc94d71f18cc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:50.056969 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4395d829-89e0-40b2-a8c7-bc94d71f18cc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:50.063688 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4395d829-89e0-40b2-a8c7-bc94d71f18cc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:50.064145 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4395d829-89e0-40b2-a8c7-bc94d71f18cc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:50.064903 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4395d829-89e0-40b2-a8c7-bc94d71f18cc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:50.065339 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4395d829-89e0-40b2-a8c7-bc94d71f18cc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:50.203400 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4395d829-89e0-40b2-a8c7-bc94d71f18cc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:50.211515 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4395d829-89e0-40b2-a8c7-bc94d71f18cc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:50.213249 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4395d829-89e0-40b2-a8c7-bc94d71f18cc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:50.214406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4395d829-89e0-40b2-a8c7-bc94d71f18cc tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1730 microversion: 2.20 time: 0.161966 Jun 29 12:39:50.215327 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 378/732] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:50 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:39:51.232376 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-74abc459-f728-4d46-9990-85068481303c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:39:51.232909 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-74abc459-f728-4d46-9990-85068481303c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:39:51.236033 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:39:51.242011 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-74abc459-f728-4d46-9990-85068481303c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:51.242526 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-74abc459-f728-4d46-9990-85068481303c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:51.243311 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-74abc459-f728-4d46-9990-85068481303c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:39:51.243744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-74abc459-f728-4d46-9990-85068481303c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:39:51.372124 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-74abc459-f728-4d46-9990-85068481303c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:51.380550 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-74abc459-f728-4d46-9990-85068481303c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:51.382036 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-74abc459-f728-4d46-9990-85068481303c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:39:51.383215 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-74abc459-f728-4d46-9990-85068481303c tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1717 microversion: 2.20 time: 0.154820 Jun 29 12:39:51.383778 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 355/733] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:39:51 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:40:11.437357 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5fa9a577-8f0f-440f-b315-87935f94b3ae tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:11.437909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5fa9a577-8f0f-440f-b315-87935f94b3ae tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:11.440084 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-05154e4b-10a3-4610-b83d-782659808195 req-5619f7d3-1d85-4f95-9980-24d228d2422f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72186d8a-10a4-4b4a-b57e-6e8e520dc784", "tag": "32283955-f720-4723-80b6-82d0fc44730d"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:40:11.440559 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:40:11.441118 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=91 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:40:11.447415 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5fa9a577-8f0f-440f-b315-87935f94b3ae tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:11.447908 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5fa9a577-8f0f-440f-b315-87935f94b3ae tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:11.448509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:40:11.449065 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5fa9a577-8f0f-440f-b315-87935f94b3ae tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:11.449198 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=74 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:40:11.449288 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5fa9a577-8f0f-440f-b315-87935f94b3ae tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:11.452061 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-05154e4b-10a3-4610-b83d-782659808195 req-5619f7d3-1d85-4f95-9980-24d228d2422f service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:11.452944 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-05154e4b-10a3-4610-b83d-782659808195 req-5619f7d3-1d85-4f95-9980-24d228d2422f service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:11.465531 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-05154e4b-10a3-4610-b83d-782659808195 req-5619f7d3-1d85-4f95-9980-24d228d2422f service nova] Creating event network-changed:32283955-f720-4723-80b6-82d0fc44730d for instance 72186d8a-10a4-4b4a-b57e-6e8e520dc784 on hv-cinder-81268 Jun 29 12:40:11.471233 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-05154e4b-10a3-4610-b83d-782659808195 req-5619f7d3-1d85-4f95-9980-24d228d2422f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035830 Jun 29 12:40:11.471765 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 356/734] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:40:11.478253 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5fa9a577-8f0f-440f-b315-87935f94b3ae tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Going to try to terminate instance {{(pid=124317) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 12:40:11.572751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5fa9a577-8f0f-440f-b315-87935f94b3ae tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "DELETE /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 204 len: 0 microversion: 2.1 time: 0.139731 Jun 29 12:40:11.576893 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 379/735] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:40:11 2022] DELETE /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 12:40:11.586273 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d79a1090-b4b3-4a13-a9ea-405fa4052181 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:11.588491 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d79a1090-b4b3-4a13-a9ea-405fa4052181 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:11.598124 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d79a1090-b4b3-4a13-a9ea-405fa4052181 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:11.598711 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d79a1090-b4b3-4a13-a9ea-405fa4052181 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:11.599588 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d79a1090-b4b3-4a13-a9ea-405fa4052181 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:11.600150 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d79a1090-b4b3-4a13-a9ea-405fa4052181 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:11.751803 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d79a1090-b4b3-4a13-a9ea-405fa4052181 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:11.759306 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d79a1090-b4b3-4a13-a9ea-405fa4052181 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1568 microversion: 2.1 time: 0.178903 Jun 29 12:40:11.759868 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 357/736] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:40:11 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:40:12.777515 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c61b37d9-b5d3-4b5c-a9f7-c791ac43f9f1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:12.778220 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c61b37d9-b5d3-4b5c-a9f7-c791ac43f9f1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:12.785027 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c61b37d9-b5d3-4b5c-a9f7-c791ac43f9f1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:12.785535 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c61b37d9-b5d3-4b5c-a9f7-c791ac43f9f1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:12.786326 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c61b37d9-b5d3-4b5c-a9f7-c791ac43f9f1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:12.786811 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c61b37d9-b5d3-4b5c-a9f7-c791ac43f9f1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:12.923806 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c61b37d9-b5d3-4b5c-a9f7-c791ac43f9f1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:12.931417 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c61b37d9-b5d3-4b5c-a9f7-c791ac43f9f1 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1568 microversion: 2.1 time: 0.158350 Jun 29 12:40:12.931974 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 380/737] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:40:12 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:40:13.723167 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-37351a63-4b3c-4ffa-be23-1d0ef514c4b0 req-97b130ea-4495-4c9d-b356-ed5d73d818db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72186d8a-10a4-4b4a-b57e-6e8e520dc784", "name": "network-vif-deleted", "tag": "32283955-f720-4723-80b6-82d0fc44730d"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:40:13.734900 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-37351a63-4b3c-4ffa-be23-1d0ef514c4b0 req-97b130ea-4495-4c9d-b356-ed5d73d818db service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:13.735355 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-37351a63-4b3c-4ffa-be23-1d0ef514c4b0 req-97b130ea-4495-4c9d-b356-ed5d73d818db service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:13.750823 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-37351a63-4b3c-4ffa-be23-1d0ef514c4b0 req-97b130ea-4495-4c9d-b356-ed5d73d818db service nova] Creating event network-vif-deleted:32283955-f720-4723-80b6-82d0fc44730d for instance 72186d8a-10a4-4b4a-b57e-6e8e520dc784 on hv-cinder-81268 Jun 29 12:40:13.755582 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-37351a63-4b3c-4ffa-be23-1d0ef514c4b0 req-97b130ea-4495-4c9d-b356-ed5d73d818db service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036138 Jun 29 12:40:13.756364 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 358/738] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:40:13.949163 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-757ea574-0a1e-4a42-8be7-2f8d287facb0 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:13.949775 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-757ea574-0a1e-4a42-8be7-2f8d287facb0 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:13.956700 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-757ea574-0a1e-4a42-8be7-2f8d287facb0 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:13.957147 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-757ea574-0a1e-4a42-8be7-2f8d287facb0 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:13.957899 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-757ea574-0a1e-4a42-8be7-2f8d287facb0 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:13.958332 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-757ea574-0a1e-4a42-8be7-2f8d287facb0 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:14.026326 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-757ea574-0a1e-4a42-8be7-2f8d287facb0 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f026018d7f444519983df75eb4453284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacced43dbbb4c2e98bdff0d3cc557ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:14.036663 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-757ea574-0a1e-4a42-8be7-2f8d287facb0 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 200 len: 1219 microversion: 2.1 time: 0.091337 Jun 29 12:40:14.037239 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 381/739] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:40:13 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:40:15.056208 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a18e8dcb-26cb-403e-ad95-5e7e7c2b41a6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:15.056908 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a18e8dcb-26cb-403e-ad95-5e7e7c2b41a6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] [instance: 72186d8a-10a4-4b4a-b57e-6e8e520dc784] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:15.064862 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a18e8dcb-26cb-403e-ad95-5e7e7c2b41a6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:15.065317 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a18e8dcb-26cb-403e-ad95-5e7e7c2b41a6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:15.066092 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a18e8dcb-26cb-403e-ad95-5e7e7c2b41a6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:15.066625 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a18e8dcb-26cb-403e-ad95-5e7e7c2b41a6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:15.080080 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-a18e8dcb-26cb-403e-ad95-5e7e7c2b41a6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] HTTP exception thrown: Instance 72186d8a-10a4-4b4a-b57e-6e8e520dc784 could not be found. Jun 29 12:40:15.081695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a18e8dcb-26cb-403e-ad95-5e7e7c2b41a6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Request method failure captured: Jun 29 12:40:15.081695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 HTTP/1.1 Jun 29 12:40:15.081695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept: application/json Jun 29 12:40:15.081695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jun 29 12:40:15.081695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Connection: close Jun 29 12:40:15.081695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jun 29 12:40:15.081695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jun 29 12:40:15.081695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Host: 10.222.0.52 Jun 29 12:40:15.081695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jun 29 12:40:15.081695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jun 29 12:40:15.081695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivEb-sCthEF9a38oOGKfDWUN274p4Ll0IZjUai4ftSdCriWXFPPMkRSY7cE_9eoqVHhiUAOpSJplvve9Rmk6Upg-qKIHDHbigaOvN2aQpg79xEaf3JcVE-7gy0ELtWT-Yv9OhLByeLkbPV36dJe-R3VCfYM1uJ_5px2Q3CLfco-KHt2M Jun 29 12:40:15.081695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jun 29 12:40:15.081695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jun 29 12:40:15.081695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jun 29 12:40:15.081695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jun 29 12:40:15.081695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jun 29 12:40:15.081695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jun 29 12:40:15.081695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Id: aacced43dbbb4c2e98bdff0d3cc557ad Jun 29 12:40:15.081695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-TestShelveInstance-219739888 Jun 29 12:40:15.081695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jun 29 12:40:15.081695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jun 29 12:40:15.083308 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_aacced43dbbb4c2e98bdff0d3cc557ad", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/aacced43dbbb4c2e98bdff0d3cc557ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aacced43dbbb4c2e98bdff0d3cc557ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aacced43dbbb4c2e98bdff0d3cc557ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:40:15.083308 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-TestShelveInstance-219739888 Jun 29 12:40:15.083308 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Id: aacced43dbbb4c2e98bdff0d3cc557ad Jun 29 12:40:15.083308 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-TestShelveInstance-219739888 Jun 29 12:40:15.083308 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User: tempest-TestShelveInstance-219739888-project Jun 29 12:40:15.083308 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jun 29 12:40:15.083308 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jun 29 12:40:15.083308 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Id: f026018d7f444519983df75eb4453284 Jun 29 12:40:15.083308 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-TestShelveInstance-219739888-project Jun 29 12:40:15.083308 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: method: > Jun 29 12:40:15.083308 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: exception: Instance 72186d8a-10a4-4b4a-b57e-6e8e520dc784 could not be found. Jun 29 12:40:15.083308 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: action_args: {'id': '72186d8a-10a4-4b4a-b57e-6e8e520dc784'} Jun 29 12:40:15.084186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:40:15.084186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:15.084186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:40:15.084186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:40:15.084186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:40:15.084186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:40:15.084186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:40:15.084186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:40:15.084186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:40:15.084186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:40:15.084186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72186d8a-10a4-4b4a-b57e-6e8e520dc784 could not be found. Jun 29 12:40:15.084186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:15.084186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:15.084186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:15.084186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:15.084186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:40:15.084186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:40:15.084186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:40:15.084186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:40:15.084186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:40:15.085667 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:40:15.085667 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:40:15.085667 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:40:15.085667 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:40:15.085667 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:40:15.085667 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:40:15.085667 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:40:15.085667 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72186d8a-10a4-4b4a-b57e-6e8e520dc784 could not be found. Jun 29 12:40:15.085667 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:15.085667 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:15.085667 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:15.085667 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:15.085667 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:40:15.085667 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:40:15.085667 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:40:15.085667 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:40:15.085667 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72186d8a-10a4-4b4a-b57e-6e8e520dc784 could not be found. Jun 29 12:40:15.085667 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:15.087117 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a18e8dcb-26cb-403e-ad95-5e7e7c2b41a6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Returning 404 to user: Instance 72186d8a-10a4-4b4a-b57e-6e8e520dc784 could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:40:15.087117 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a18e8dcb-26cb-403e-ad95-5e7e7c2b41a6 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784" status: 404 len: 111 microversion: 2.1 time: 0.031097 Jun 29 12:40:15.087117 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 359/740] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:40:15 2022] GET /compute/v2.1/servers/72186d8a-10a4-4b4a-b57e-6e8e520dc784 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:40:15.238879 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-36437171-9b90-47ec-ab9d-356bc6b50c58 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] Calling method '.version_select at 0x7fdb06903280>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:15.258583 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-36437171-9b90-47ec-ab9d-356bc6b50c58 tempest-TestShelveInstance-219739888 tempest-TestShelveInstance-219739888-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-112282750" status: 202 len: 0 microversion: 2.1 time: 0.023391 Jun 29 12:40:15.259171 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 382/741] 10.222.0.52 () {58 vars in 1250 bytes} [Wed Jun 29 12:40:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-112282750 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:40:23.250311 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c0f04573-b089-41dd-b2ab-3a64f307d52a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:23.250893 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c0f04573-b089-41dd-b2ab-3a64f307d52a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:23.256891 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c0f04573-b089-41dd-b2ab-3a64f307d52a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:23.257338 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c0f04573-b089-41dd-b2ab-3a64f307d52a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:23.258140 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c0f04573-b089-41dd-b2ab-3a64f307d52a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:23.258784 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c0f04573-b089-41dd-b2ab-3a64f307d52a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:23.282876 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c0f04573-b089-41dd-b2ab-3a64f307d52a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338/ips" status: 200 len: 148 microversion: 2.1 time: 0.036369 Jun 29 12:40:23.283415 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 360/742] 10.222.0.52 () {58 vars in 1247 bytes} [Wed Jun 29 12:40:23 2022] GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:40:23.294662 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-17dbe796-027f-42ff-ba0b-042c17f86d3a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38cbf88d-cec2-422b-8d8d-65219bf0f328"}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:40:23.295744 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-17dbe796-027f-42ff-ba0b-042c17f86d3a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:23.304891 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-17dbe796-027f-42ff-ba0b-042c17f86d3a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:23.305337 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-17dbe796-027f-42ff-ba0b-042c17f86d3a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:23.306095 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-17dbe796-027f-42ff-ba0b-042c17f86d3a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:23.306557 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-17dbe796-027f-42ff-ba0b-042c17f86d3a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:23.385953 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-17dbe796-027f-42ff-ba0b-042c17f86d3a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] HTTP exception thrown: Invalid volume: volume 38cbf88d-cec2-422b-8d8d-65219bf0f328 is already attached to instances: c8419121-12d7-431e-9ff0-dfa04c64cd00 Jun 29 12:40:23.387752 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-17dbe796-027f-42ff-ba0b-042c17f86d3a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Request method failure captured: Jun 29 12:40:23.387752 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: POST /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338/os-volume_attachments HTTP/1.1 Jun 29 12:40:23.387752 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:40:23.387752 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:40:23.387752 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:40:23.387752 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 74 Jun 29 12:40:23.387752 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:40:23.387752 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:40:23.387752 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:40:23.387752 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:40:23.387752 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEe69aM7amLLdDw45pZkO9qxIeRFDOBVDEG3SD63-th4vjx46p2B2ho9vub7AbBeiopTeWWiq0plzI-faJHgEw8JRp3OpSKxo8ZAn9rjDDJbshayaHyBTJQDtsbH4um2iDB62naNRbVeYQvavven9SyQAHp1o14QRaoNvsRRGeWVuWU Jun 29 12:40:23.387752 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:40:23.387752 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:40:23.387752 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:40:23.387752 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:40:23.387752 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:40:23.387752 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:40:23.387752 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:40:23.387752 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:40:23.387752 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:40:23.387752 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:40:23.389362 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f18ffa75c23e4276a8b5b4fc3821fb87", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:40:23.389362 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:40:23.389362 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:40:23.389362 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:40:23.389362 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:40:23.389362 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:40:23.389362 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:40:23.389362 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: 2af4d4a69e9d4755bff61401f4349c78 Jun 29 12:40:23.389362 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:40:23.389362 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Jun 29 12:40:23.389362 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {"volumeAttachment": {"volumeId": "38cbf88d-cec2-422b-8d8d-65219bf0f328"}} Jun 29 12:40:23.389362 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:40:23.390294 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Invalid volume: volume 38cbf88d-cec2-422b-8d8d-65219bf0f328 is already attached to instances: c8419121-12d7-431e-9ff0-dfa04c64cd00 Jun 29 12:40:23.390294 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'server_id': 'd363d4d7-f546-4939-9ac6-bd4eb1118338', 'body': {'volumeAttachment': {'volumeId': '38cbf88d-cec2-422b-8d8d-65219bf0f328'}}} Jun 29 12:40:23.390294 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:40:23.390294 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:23.390294 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 29 12:40:23.390294 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 29 12:40:23.390294 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 12:40:23.390294 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 12:40:23.390294 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 12:40:23.390294 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 12:40:23.390294 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 29 12:40:23.390294 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 29 12:40:23.390294 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 29 12:40:23.390294 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 29 12:40:23.390294 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 38cbf88d-cec2-422b-8d8d-65219bf0f328 is already attached to instances: c8419121-12d7-431e-9ff0-dfa04c64cd00 Jun 29 12:40:23.390294 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:23.390294 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:23.390294 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:23.390294 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:23.392455 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:40:23.392455 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:40:23.392455 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:40:23.392455 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:40:23.392455 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:40:23.392455 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:40:23.392455 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 12:40:23.392455 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 12:40:23.392455 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 12:40:23.392455 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 12:40:23.392455 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 12:40:23.392455 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 12:40:23.392455 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 29 12:40:23.392455 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 12:40:23.392455 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 38cbf88d-cec2-422b-8d8d-65219bf0f328 is already attached to instances: c8419121-12d7-431e-9ff0-dfa04c64cd00 Jun 29 12:40:23.392455 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:23.392455 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:23.392455 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:23.392455 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:23.392455 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:40:23.393916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:40:23.393916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:40:23.393916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:40:23.393916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 38cbf88d-cec2-422b-8d8d-65219bf0f328 is already attached to instances: c8419121-12d7-431e-9ff0-dfa04c64cd00 Jun 29 12:40:23.393916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:23.393916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-17dbe796-027f-42ff-ba0b-042c17f86d3a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Returning 400 to user: Invalid volume: volume 38cbf88d-cec2-422b-8d8d-65219bf0f328 is already attached to instances: c8419121-12d7-431e-9ff0-dfa04c64cd00 {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:40:23.393916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-17dbe796-027f-42ff-ba0b-042c17f86d3a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "POST /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099156 Jun 29 12:40:23.393916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 383/743] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Jun 29 12:40:23 2022] POST /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 12:40:23.399106 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6ab2eec4-a256-48d8-a2e3-cac2ec9cf8bb tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:23.399631 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6ab2eec4-a256-48d8-a2e3-cac2ec9cf8bb tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:23.405591 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6ab2eec4-a256-48d8-a2e3-cac2ec9cf8bb tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:23.407240 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6ab2eec4-a256-48d8-a2e3-cac2ec9cf8bb tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:23.408013 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6ab2eec4-a256-48d8-a2e3-cac2ec9cf8bb tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:23.408455 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6ab2eec4-a256-48d8-a2e3-cac2ec9cf8bb tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:23.432591 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6ab2eec4-a256-48d8-a2e3-cac2ec9cf8bb tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 12:40:23.507392 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6ab2eec4-a256-48d8-a2e3-cac2ec9cf8bb tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338" status: 204 len: 0 microversion: 2.1 time: 0.111938 Jun 29 12:40:23.507855 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 361/744] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:40:23 2022] DELETE /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 12:40:23.516419 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d97cc0bd-4bab-4f3b-a407-fa73d690d5f9 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:23.517098 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d97cc0bd-4bab-4f3b-a407-fa73d690d5f9 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:23.524006 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d97cc0bd-4bab-4f3b-a407-fa73d690d5f9 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:23.524457 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d97cc0bd-4bab-4f3b-a407-fa73d690d5f9 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:23.525223 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d97cc0bd-4bab-4f3b-a407-fa73d690d5f9 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:23.525662 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d97cc0bd-4bab-4f3b-a407-fa73d690d5f9 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:23.656788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d97cc0bd-4bab-4f3b-a407-fa73d690d5f9 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:23.664126 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d97cc0bd-4bab-4f3b-a407-fa73d690d5f9 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338" status: 200 len: 1678 microversion: 2.1 time: 0.152132 Jun 29 12:40:23.664679 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 384/745] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:40:23 2022] GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:40:24.681275 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6c182489-8286-4b4c-b28b-a223b15f5029 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:24.681896 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6c182489-8286-4b4c-b28b-a223b15f5029 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:24.688659 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6c182489-8286-4b4c-b28b-a223b15f5029 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:24.689109 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6c182489-8286-4b4c-b28b-a223b15f5029 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:24.689871 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6c182489-8286-4b4c-b28b-a223b15f5029 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:24.690311 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6c182489-8286-4b4c-b28b-a223b15f5029 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:24.822831 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6c182489-8286-4b4c-b28b-a223b15f5029 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:24.831098 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6c182489-8286-4b4c-b28b-a223b15f5029 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338" status: 200 len: 1678 microversion: 2.1 time: 0.154092 Jun 29 12:40:24.831671 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 362/746] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:40:24 2022] GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:40:24.900261 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ef5b73ee-b39c-4b6a-9e2c-082f72add8c5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:24.901232 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ef5b73ee-b39c-4b6a-9e2c-082f72add8c5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:24.908653 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ef5b73ee-b39c-4b6a-9e2c-082f72add8c5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:24.909098 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ef5b73ee-b39c-4b6a-9e2c-082f72add8c5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:24.909848 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ef5b73ee-b39c-4b6a-9e2c-082f72add8c5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:24.910281 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ef5b73ee-b39c-4b6a-9e2c-082f72add8c5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:24.938694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ef5b73ee-b39c-4b6a-9e2c-082f72add8c5 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042857 Jun 29 12:40:24.939170 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 385/747] 10.222.0.52 () {60 vars in 1342 bytes} [Wed Jun 29 12:40:24 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:40:24.998131 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-abafc50b-df72-4b84-8b42-af3bdde1b6f4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:24.998649 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-abafc50b-df72-4b84-8b42-af3bdde1b6f4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:25.005191 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-abafc50b-df72-4b84-8b42-af3bdde1b6f4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:25.005637 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-abafc50b-df72-4b84-8b42-af3bdde1b6f4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:25.006390 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-abafc50b-df72-4b84-8b42-af3bdde1b6f4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:25.006854 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-abafc50b-df72-4b84-8b42-af3bdde1b6f4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:25.032723 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-abafc50b-df72-4b84-8b42-af3bdde1b6f4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 12:40:25.114824 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-abafc50b-df72-4b84-8b42-af3bdde1b6f4 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 204 len: 0 microversion: 2.20 time: 0.120071 Jun 29 12:40:25.115653 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 363/748] 10.222.0.52 () {60 vars in 1279 bytes} [Wed Jun 29 12:40:24 2022] DELETE /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 29 12:40:25.124135 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-325ca636-0d75-41b6-b51e-6c6bc21213d7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:25.124867 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-325ca636-0d75-41b6-b51e-6c6bc21213d7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:25.130835 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-325ca636-0d75-41b6-b51e-6c6bc21213d7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:25.131276 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-325ca636-0d75-41b6-b51e-6c6bc21213d7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:25.132023 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-325ca636-0d75-41b6-b51e-6c6bc21213d7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:25.132451 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-325ca636-0d75-41b6-b51e-6c6bc21213d7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:25.261947 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-325ca636-0d75-41b6-b51e-6c6bc21213d7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:25.269925 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-325ca636-0d75-41b6-b51e-6c6bc21213d7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:25.271749 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-325ca636-0d75-41b6-b51e-6c6bc21213d7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:25.272915 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-325ca636-0d75-41b6-b51e-6c6bc21213d7 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1723 microversion: 2.20 time: 0.152635 Jun 29 12:40:25.273459 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 386/749] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:40:25 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:40:25.777352 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-c1b19c03-c490-46e4-9f6d-a35743e370fa req-d3a42efa-6d56-44dc-9767-2204dec2e093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d363d4d7-f546-4939-9ac6-bd4eb1118338", "name": "network-vif-deleted", "tag": "c149decc-6a28-4e86-8dc3-2be54897e82e"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:40:25.786010 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-c1b19c03-c490-46e4-9f6d-a35743e370fa req-d3a42efa-6d56-44dc-9767-2204dec2e093 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:25.786462 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-c1b19c03-c490-46e4-9f6d-a35743e370fa req-d3a42efa-6d56-44dc-9767-2204dec2e093 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:25.798048 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-c1b19c03-c490-46e4-9f6d-a35743e370fa req-d3a42efa-6d56-44dc-9767-2204dec2e093 service nova] Creating event network-vif-deleted:c149decc-6a28-4e86-8dc3-2be54897e82e for instance d363d4d7-f546-4939-9ac6-bd4eb1118338 on hv-cinder-81268 Jun 29 12:40:25.802896 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-c1b19c03-c490-46e4-9f6d-a35743e370fa req-d3a42efa-6d56-44dc-9767-2204dec2e093 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029550 Jun 29 12:40:25.803668 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 364/750] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:40:25.849779 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-00b4a4c5-810a-4dc3-a1dd-f23193688402 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:25.850462 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-00b4a4c5-810a-4dc3-a1dd-f23193688402 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:25.856934 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-00b4a4c5-810a-4dc3-a1dd-f23193688402 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:25.857379 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-00b4a4c5-810a-4dc3-a1dd-f23193688402 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:25.858139 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-00b4a4c5-810a-4dc3-a1dd-f23193688402 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:25.858598 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-00b4a4c5-810a-4dc3-a1dd-f23193688402 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:25.925024 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-00b4a4c5-810a-4dc3-a1dd-f23193688402 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:25.933178 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-00b4a4c5-810a-4dc3-a1dd-f23193688402 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338" status: 200 len: 1611 microversion: 2.1 time: 0.087240 Jun 29 12:40:25.942946 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 387/751] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:40:25 2022] GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 => generated 1611 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:40:26.292191 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6c9cdbae-c3a6-474f-a06b-5e890fd12c73 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:26.293171 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6c9cdbae-c3a6-474f-a06b-5e890fd12c73 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:26.300749 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6c9cdbae-c3a6-474f-a06b-5e890fd12c73 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:26.301477 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6c9cdbae-c3a6-474f-a06b-5e890fd12c73 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:26.302441 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6c9cdbae-c3a6-474f-a06b-5e890fd12c73 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:26.303054 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6c9cdbae-c3a6-474f-a06b-5e890fd12c73 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:26.476113 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6c9cdbae-c3a6-474f-a06b-5e890fd12c73 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:26.486272 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6c9cdbae-c3a6-474f-a06b-5e890fd12c73 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:26.487970 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6c9cdbae-c3a6-474f-a06b-5e890fd12c73 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:26.489199 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6c9cdbae-c3a6-474f-a06b-5e890fd12c73 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1723 microversion: 2.20 time: 0.201685 Jun 29 12:40:26.489677 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 365/752] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:40:26 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:40:26.950758 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-97e7e70d-940b-479f-85bc-69a543fcdb59 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:26.951362 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-97e7e70d-940b-479f-85bc-69a543fcdb59 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:26.958405 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-97e7e70d-940b-479f-85bc-69a543fcdb59 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:26.958894 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-97e7e70d-940b-479f-85bc-69a543fcdb59 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:26.959752 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-97e7e70d-940b-479f-85bc-69a543fcdb59 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:26.960192 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-97e7e70d-940b-479f-85bc-69a543fcdb59 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:26.974530 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-97e7e70d-940b-479f-85bc-69a543fcdb59 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] HTTP exception thrown: Instance d363d4d7-f546-4939-9ac6-bd4eb1118338 could not be found. Jun 29 12:40:26.976257 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-97e7e70d-940b-479f-85bc-69a543fcdb59 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Request method failure captured: Jun 29 12:40:26.976257 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 HTTP/1.1 Jun 29 12:40:26.976257 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:40:26.976257 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:40:26.976257 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:40:26.976257 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:40:26.976257 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:40:26.976257 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:40:26.976257 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:40:26.976257 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:40:26.976257 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEe69aM7amLLdDw45pZkO9qxIeRFDOBVDEG3SD63-th4vjx46p2B2ho9vub7AbBeiopTeWWiq0plzI-faJHgEw8JRp3OpSKxo8ZAn9rjDDJbshayaHyBTJQDtsbH4um2iDB62naNRbVeYQvavven9SyQAHp1o14QRaoNvsRRGeWVuWU Jun 29 12:40:26.976257 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:40:26.976257 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:40:26.976257 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:40:26.976257 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:40:26.976257 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:40:26.976257 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:40:26.976257 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:40:26.976257 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:40:26.976257 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:40:26.976257 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:40:26.977783 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f18ffa75c23e4276a8b5b4fc3821fb87", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:40:26.977783 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:40:26.977783 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:40:26.977783 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:40:26.977783 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:40:26.977783 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:40:26.977783 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:40:26.977783 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: 2af4d4a69e9d4755bff61401f4349c78 Jun 29 12:40:26.977783 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:40:26.977783 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:40:26.977783 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Instance d363d4d7-f546-4939-9ac6-bd4eb1118338 could not be found. Jun 29 12:40:26.977783 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': 'd363d4d7-f546-4939-9ac6-bd4eb1118338'} Jun 29 12:40:26.978909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:40:26.978909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:26.978909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:40:26.978909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:40:26.978909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:40:26.978909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:40:26.978909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:40:26.978909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:40:26.978909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:40:26.978909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:40:26.978909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d363d4d7-f546-4939-9ac6-bd4eb1118338 could not be found. Jun 29 12:40:26.978909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:26.978909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:26.978909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:26.978909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:26.978909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:40:26.978909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:40:26.978909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:40:26.978909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:40:26.978909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:40:26.980374 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:40:26.980374 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:40:26.980374 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:40:26.980374 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:40:26.980374 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:40:26.980374 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:40:26.980374 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:40:26.980374 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d363d4d7-f546-4939-9ac6-bd4eb1118338 could not be found. Jun 29 12:40:26.980374 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:26.980374 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:26.980374 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:26.980374 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:26.980374 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:40:26.980374 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:40:26.980374 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:40:26.980374 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:40:26.980374 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d363d4d7-f546-4939-9ac6-bd4eb1118338 could not be found. Jun 29 12:40:26.980374 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:26.981709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-97e7e70d-940b-479f-85bc-69a543fcdb59 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Returning 404 to user: Instance d363d4d7-f546-4939-9ac6-bd4eb1118338 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:40:26.981709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-97e7e70d-940b-479f-85bc-69a543fcdb59 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338" status: 404 len: 111 microversion: 2.1 time: 0.030801 Jun 29 12:40:26.981709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 388/753] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:40:26 2022] GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 12:40:26.990948 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2778b94b-2c30-4b5f-bc8a-d42030dd8d8c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '.version_select at 0x7fdb06839040>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:27.009595 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2778b94b-2c30-4b5f-bc8a-d42030dd8d8c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1258415520" status: 202 len: 0 microversion: 2.1 time: 0.022375 Jun 29 12:40:27.010093 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 366/754] 10.222.0.52 () {58 vars in 1220 bytes} [Wed Jun 29 12:40:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1258415520 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:40:27.506904 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-260e463b-2fec-4266-90ff-487ba2724158 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:27.507907 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-260e463b-2fec-4266-90ff-487ba2724158 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:27.514274 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-260e463b-2fec-4266-90ff-487ba2724158 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:27.514639 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-260e463b-2fec-4266-90ff-487ba2724158 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:27.516137 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-260e463b-2fec-4266-90ff-487ba2724158 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:27.517348 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-260e463b-2fec-4266-90ff-487ba2724158 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:27.613814 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-260e463b-2fec-4266-90ff-487ba2724158 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:27.624382 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-260e463b-2fec-4266-90ff-487ba2724158 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:27.625979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-260e463b-2fec-4266-90ff-487ba2724158 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6252d0519ed9421e89710ca5294524c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed882ae485441db99ccf6109be51b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:27.627358 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-260e463b-2fec-4266-90ff-487ba2724158 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 200 len: 1655 microversion: 2.20 time: 0.124556 Jun 29 12:40:27.628223 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 389/755] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:40:27 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 1655 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 12:40:27.746766 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-34779a60-19b6-418c-a46e-acc32ab46743 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:27.747385 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-34779a60-19b6-418c-a46e-acc32ab46743 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: c8419121-12d7-431e-9ff0-dfa04c64cd00] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:27.755045 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-34779a60-19b6-418c-a46e-acc32ab46743 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:27.757666 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-34779a60-19b6-418c-a46e-acc32ab46743 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:27.758652 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-34779a60-19b6-418c-a46e-acc32ab46743 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:27.759105 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-34779a60-19b6-418c-a46e-acc32ab46743 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:27.819236 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-075850b4-c14b-4e78-b3c3-8b9a11bd9133 req-2c087737-6a8d-400c-a5ce-86e5f6eb3a70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6005eeb-de9c-4299-85da-6bf176fba2db", "name": "network-vif-deleted", "tag": "91513e0c-31ea-42a7-a298-8bcc2b5e8547"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:40:27.831687 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-075850b4-c14b-4e78-b3c3-8b9a11bd9133 req-2c087737-6a8d-400c-a5ce-86e5f6eb3a70 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:27.833914 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-075850b4-c14b-4e78-b3c3-8b9a11bd9133 req-2c087737-6a8d-400c-a5ce-86e5f6eb3a70 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:27.851563 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-075850b4-c14b-4e78-b3c3-8b9a11bd9133 req-2c087737-6a8d-400c-a5ce-86e5f6eb3a70 service nova] Creating event network-vif-deleted:91513e0c-31ea-42a7-a298-8bcc2b5e8547 for instance b6005eeb-de9c-4299-85da-6bf176fba2db on hv-cinder-81268 Jun 29 12:40:27.857695 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-075850b4-c14b-4e78-b3c3-8b9a11bd9133 req-2c087737-6a8d-400c-a5ce-86e5f6eb3a70 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042419 Jun 29 12:40:27.859029 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 390/756] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:40:27.882922 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-34779a60-19b6-418c-a46e-acc32ab46743 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lazy-loading 'services' on Instance uuid c8419121-12d7-431e-9ff0-dfa04c64cd00 {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 12:40:27.970984 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-34779a60-19b6-418c-a46e-acc32ab46743 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00/os-volume_attachments/38cbf88d-cec2-422b-8d8d-65219bf0f328" status: 202 len: 0 microversion: 2.1 time: 0.228157 Jun 29 12:40:27.974747 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 367/757] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 12:40:27 2022] DELETE /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00/os-volume_attachments/38cbf88d-cec2-422b-8d8d-65219bf0f328 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:40:27.980741 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a2f12013-bdcf-4742-968c-1c6f4a4297ea tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:27.981748 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a2f12013-bdcf-4742-968c-1c6f4a4297ea tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: c8419121-12d7-431e-9ff0-dfa04c64cd00] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:27.989308 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a2f12013-bdcf-4742-968c-1c6f4a4297ea tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:27.989744 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a2f12013-bdcf-4742-968c-1c6f4a4297ea tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:27.990546 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a2f12013-bdcf-4742-968c-1c6f4a4297ea tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:27.991019 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a2f12013-bdcf-4742-968c-1c6f4a4297ea tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:28.027163 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a2f12013-bdcf-4742-968c-1c6f4a4297ea tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050814 Jun 29 12:40:28.028343 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 391/758] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 12:40:27 2022] GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:40:28.647186 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-efe375cc-67c8-4d07-b31d-74a6ea3ff612 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:28.647893 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-efe375cc-67c8-4d07-b31d-74a6ea3ff612 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:28.654277 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-efe375cc-67c8-4d07-b31d-74a6ea3ff612 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:28.654804 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-efe375cc-67c8-4d07-b31d-74a6ea3ff612 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:28.655625 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-efe375cc-67c8-4d07-b31d-74a6ea3ff612 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:28.656650 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-efe375cc-67c8-4d07-b31d-74a6ea3ff612 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:28.670547 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-efe375cc-67c8-4d07-b31d-74a6ea3ff612 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] HTTP exception thrown: Instance b6005eeb-de9c-4299-85da-6bf176fba2db could not be found. Jun 29 12:40:28.672425 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-efe375cc-67c8-4d07-b31d-74a6ea3ff612 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Request method failure captured: Jun 29 12:40:28.672425 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db HTTP/1.1 Jun 29 12:40:28.672425 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept: application/json Jun 29 12:40:28.672425 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jun 29 12:40:28.672425 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Connection: close Jun 29 12:40:28.672425 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jun 29 12:40:28.672425 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jun 29 12:40:28.672425 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Host: 10.222.0.52 Jun 29 12:40:28.672425 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jun 29 12:40:28.672425 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jun 29 12:40:28.672425 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivEaSW5D-CqEu29RVBGKm9IlqDK1jdGTv6OTojemrW-D2tajaadA5m5XiLrdimXj1PsJ0rWVBy6y3eVdvkOLNkwyWS8hT_HXhLScyJIUV6nVaQgGHeYsf2E4AYFv4d8NTzSuOA6Nv4uz_0tXpA7AfmubyVOX1nTpaDJUy-fSvZ8DINWo Jun 29 12:40:28.672425 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jun 29 12:40:28.672425 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jun 29 12:40:28.672425 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jun 29 12:40:28.672425 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jun 29 12:40:28.672425 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 12:40:28.672425 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jun 29 12:40:28.672425 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jun 29 12:40:28.672425 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Id: 0ed882ae485441db99ccf6109be51b22 Jun 29 12:40:28.672425 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-211799616 Jun 29 12:40:28.672425 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jun 29 12:40:28.672425 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jun 29 12:40:28.673807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0ed882ae485441db99ccf6109be51b22", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0ed882ae485441db99ccf6109be51b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ed882ae485441db99ccf6109be51b22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ed882ae485441db99ccf6109be51b22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:40:28.673807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-AttachVolumeShelveTestJSON-211799616 Jun 29 12:40:28.673807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Id: 0ed882ae485441db99ccf6109be51b22 Jun 29 12:40:28.673807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-211799616 Jun 29 12:40:28.673807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User: tempest-AttachVolumeShelveTestJSON-211799616-project Jun 29 12:40:28.673807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jun 29 12:40:28.673807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jun 29 12:40:28.673807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Id: 6252d0519ed9421e89710ca5294524c5 Jun 29 12:40:28.673807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-AttachVolumeShelveTestJSON-211799616-project Jun 29 12:40:28.673807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: method: > Jun 29 12:40:28.673807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: exception: Instance b6005eeb-de9c-4299-85da-6bf176fba2db could not be found. Jun 29 12:40:28.673807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: action_args: {'id': 'b6005eeb-de9c-4299-85da-6bf176fba2db'} Jun 29 12:40:28.674617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:40:28.674617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:28.674617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:40:28.674617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:40:28.674617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:40:28.674617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:40:28.674617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:40:28.674617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:40:28.674617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:40:28.674617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:40:28.674617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6005eeb-de9c-4299-85da-6bf176fba2db could not be found. Jun 29 12:40:28.674617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:28.674617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:28.674617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:28.674617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:28.674617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:40:28.674617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:40:28.674617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:40:28.674617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:40:28.674617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:40:28.676538 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:40:28.676538 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:40:28.676538 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:40:28.676538 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:40:28.676538 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:40:28.676538 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:40:28.676538 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:40:28.676538 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6005eeb-de9c-4299-85da-6bf176fba2db could not be found. Jun 29 12:40:28.676538 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:28.676538 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:28.676538 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:28.676538 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:28.676538 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:40:28.676538 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:40:28.676538 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:40:28.676538 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:40:28.676538 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6005eeb-de9c-4299-85da-6bf176fba2db could not be found. Jun 29 12:40:28.676538 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:28.678008 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-efe375cc-67c8-4d07-b31d-74a6ea3ff612 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Returning 404 to user: Instance b6005eeb-de9c-4299-85da-6bf176fba2db could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:40:28.678008 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-efe375cc-67c8-4d07-b31d-74a6ea3ff612 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 404 len: 111 microversion: 2.20 time: 0.032013 Jun 29 12:40:28.678008 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 368/759] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:40:28 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 12:40:28.683375 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-10afb3a9-1491-4247-ac1a-df84d9b543f2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '.version_select at 0x7fdb06851a60>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:28.705019 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-10afb3a9-1491-4247-ac1a-df84d9b543f2 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1995470163" status: 204 len: 0 microversion: 2.20 time: 0.025388 Jun 29 12:40:28.705876 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 392/760] 10.222.0.52 () {60 vars in 1261 bytes} [Wed Jun 29 12:40:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1995470163 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 29 12:40:29.039307 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6dd2eeae-e58d-4785-8d65-5ee627f35def tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:29.040296 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6dd2eeae-e58d-4785-8d65-5ee627f35def tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: c8419121-12d7-431e-9ff0-dfa04c64cd00] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:29.046718 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6dd2eeae-e58d-4785-8d65-5ee627f35def tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:29.047012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6dd2eeae-e58d-4785-8d65-5ee627f35def tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:29.047822 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6dd2eeae-e58d-4785-8d65-5ee627f35def tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:29.048263 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6dd2eeae-e58d-4785-8d65-5ee627f35def tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:29.080577 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6dd2eeae-e58d-4785-8d65-5ee627f35def tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045191 Jun 29 12:40:29.081128 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 369/761] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 12:40:29 2022] GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 12:40:29.139034 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c4325da1-a794-4c81-b523-472cce025766 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:29.139776 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c4325da1-a794-4c81-b523-472cce025766 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: c8419121-12d7-431e-9ff0-dfa04c64cd00] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:29.147574 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c4325da1-a794-4c81-b523-472cce025766 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:29.147948 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c4325da1-a794-4c81-b523-472cce025766 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:29.148852 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c4325da1-a794-4c81-b523-472cce025766 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:29.149317 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c4325da1-a794-4c81-b523-472cce025766 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:29.174831 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c4325da1-a794-4c81-b523-472cce025766 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: c8419121-12d7-431e-9ff0-dfa04c64cd00] Going to try to terminate instance {{(pid=124317) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 12:40:29.252997 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c4325da1-a794-4c81-b523-472cce025766 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00" status: 204 len: 0 microversion: 2.1 time: 0.117920 Jun 29 12:40:29.253695 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 393/762] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:40:29 2022] DELETE /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 12:40:29.261867 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3d4d9f7e-684a-48c9-85ee-6f6f353842a7 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:29.262940 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3d4d9f7e-684a-48c9-85ee-6f6f353842a7 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: c8419121-12d7-431e-9ff0-dfa04c64cd00] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:29.273285 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3d4d9f7e-684a-48c9-85ee-6f6f353842a7 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:29.273753 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3d4d9f7e-684a-48c9-85ee-6f6f353842a7 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:29.274598 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3d4d9f7e-684a-48c9-85ee-6f6f353842a7 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:29.275044 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3d4d9f7e-684a-48c9-85ee-6f6f353842a7 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:29.411418 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3d4d9f7e-684a-48c9-85ee-6f6f353842a7 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:29.419092 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3d4d9f7e-684a-48c9-85ee-6f6f353842a7 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00" status: 200 len: 1682 microversion: 2.1 time: 0.161077 Jun 29 12:40:29.419882 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 370/763] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:40:29 2022] GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:40:30.437844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-7d519704-ab46-4113-aa9c-5b32b7d839dc tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:30.438588 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-7d519704-ab46-4113-aa9c-5b32b7d839dc tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: c8419121-12d7-431e-9ff0-dfa04c64cd00] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:30.445082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7d519704-ab46-4113-aa9c-5b32b7d839dc tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:30.445536 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7d519704-ab46-4113-aa9c-5b32b7d839dc tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:30.446299 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7d519704-ab46-4113-aa9c-5b32b7d839dc tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:30.446766 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7d519704-ab46-4113-aa9c-5b32b7d839dc tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:30.488746 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3f3f7f01-3e26-4c2e-8e79-510e3663b7fe tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:30.489372 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3f3f7f01-3e26-4c2e-8e79-510e3663b7fe tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:30.495494 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3f3f7f01-3e26-4c2e-8e79-510e3663b7fe tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:30.496016 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3f3f7f01-3e26-4c2e-8e79-510e3663b7fe tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:30.496868 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3f3f7f01-3e26-4c2e-8e79-510e3663b7fe tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:30.497368 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3f3f7f01-3e26-4c2e-8e79-510e3663b7fe tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:30.511042 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-3f3f7f01-3e26-4c2e-8e79-510e3663b7fe tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] HTTP exception thrown: Instance b6005eeb-de9c-4299-85da-6bf176fba2db could not be found. Jun 29 12:40:30.512684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3f3f7f01-3e26-4c2e-8e79-510e3663b7fe tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Request method failure captured: Jun 29 12:40:30.512684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: request: DELETE /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db HTTP/1.1 Jun 29 12:40:30.512684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept: application/json Jun 29 12:40:30.512684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jun 29 12:40:30.512684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Connection: close Jun 29 12:40:30.512684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jun 29 12:40:30.512684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jun 29 12:40:30.512684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Host: 10.222.0.52 Jun 29 12:40:30.512684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jun 29 12:40:30.512684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jun 29 12:40:30.512684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivEaSW5D-CqEu29RVBGKm9IlqDK1jdGTv6OTojemrW-D2tajaadA5m5XiLrdimXj1PsJ0rWVBy6y3eVdvkOLNkwyWS8hT_HXhLScyJIUV6nVaQgGHeYsf2E4AYFv4d8NTzSuOA6Nv4uz_0tXpA7AfmubyVOX1nTpaDJUy-fSvZ8DINWo Jun 29 12:40:30.512684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jun 29 12:40:30.512684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jun 29 12:40:30.512684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jun 29 12:40:30.512684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jun 29 12:40:30.512684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 12:40:30.512684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jun 29 12:40:30.512684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jun 29 12:40:30.512684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Id: 0ed882ae485441db99ccf6109be51b22 Jun 29 12:40:30.512684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-211799616 Jun 29 12:40:30.512684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jun 29 12:40:30.512684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jun 29 12:40:30.514312 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0ed882ae485441db99ccf6109be51b22", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0ed882ae485441db99ccf6109be51b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ed882ae485441db99ccf6109be51b22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ed882ae485441db99ccf6109be51b22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:40:30.514312 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-AttachVolumeShelveTestJSON-211799616 Jun 29 12:40:30.514312 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Id: 0ed882ae485441db99ccf6109be51b22 Jun 29 12:40:30.514312 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-211799616 Jun 29 12:40:30.514312 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User: tempest-AttachVolumeShelveTestJSON-211799616-project Jun 29 12:40:30.514312 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jun 29 12:40:30.514312 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jun 29 12:40:30.514312 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Id: 6252d0519ed9421e89710ca5294524c5 Jun 29 12:40:30.514312 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-AttachVolumeShelveTestJSON-211799616-project Jun 29 12:40:30.514312 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: method: > Jun 29 12:40:30.514312 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: exception: Instance b6005eeb-de9c-4299-85da-6bf176fba2db could not be found. Jun 29 12:40:30.514312 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: action_args: {'id': 'b6005eeb-de9c-4299-85da-6bf176fba2db'} Jun 29 12:40:30.515157 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:40:30.515157 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:30.515157 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:40:30.515157 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:40:30.515157 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:40:30.515157 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:40:30.515157 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:40:30.515157 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:40:30.515157 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:40:30.515157 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:40:30.515157 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6005eeb-de9c-4299-85da-6bf176fba2db could not be found. Jun 29 12:40:30.515157 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:30.515157 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:30.515157 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:30.515157 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:30.515157 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:40:30.515157 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:40:30.515157 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:40:30.515157 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:40:30.515157 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:40:30.516929 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:40:30.516929 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 12:40:30.516929 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 12:40:30.516929 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 12:40:30.516929 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 12:40:30.516929 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:40:30.516929 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:40:30.516929 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:40:30.516929 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:40:30.516929 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6005eeb-de9c-4299-85da-6bf176fba2db could not be found. Jun 29 12:40:30.516929 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:30.516929 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:30.516929 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:30.516929 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:30.516929 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:40:30.516929 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:40:30.516929 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:40:30.516929 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:40:30.516929 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6005eeb-de9c-4299-85da-6bf176fba2db could not be found. Jun 29 12:40:30.516929 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:30.518352 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3f3f7f01-3e26-4c2e-8e79-510e3663b7fe tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Returning 404 to user: Instance b6005eeb-de9c-4299-85da-6bf176fba2db could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:40:30.518352 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3f3f7f01-3e26-4c2e-8e79-510e3663b7fe tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 404 len: 111 microversion: 2.20 time: 0.031252 Jun 29 12:40:30.518352 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 371/764] 10.222.0.52 () {60 vars in 1279 bytes} [Wed Jun 29 12:40:30 2022] DELETE /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 29 12:40:30.523654 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-22faef0d-f96d-4528-a117-d8d30a42cebb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:30.524414 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-22faef0d-f96d-4528-a117-d8d30a42cebb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: b6005eeb-de9c-4299-85da-6bf176fba2db] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:30.530554 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-22faef0d-f96d-4528-a117-d8d30a42cebb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:30.531510 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-22faef0d-f96d-4528-a117-d8d30a42cebb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:30.532581 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-22faef0d-f96d-4528-a117-d8d30a42cebb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:30.533017 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-22faef0d-f96d-4528-a117-d8d30a42cebb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:30.547265 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-22faef0d-f96d-4528-a117-d8d30a42cebb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] HTTP exception thrown: Instance b6005eeb-de9c-4299-85da-6bf176fba2db could not be found. Jun 29 12:40:30.548989 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-22faef0d-f96d-4528-a117-d8d30a42cebb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Request method failure captured: Jun 29 12:40:30.548989 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db HTTP/1.1 Jun 29 12:40:30.548989 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept: application/json Jun 29 12:40:30.548989 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jun 29 12:40:30.548989 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Connection: close Jun 29 12:40:30.548989 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jun 29 12:40:30.548989 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jun 29 12:40:30.548989 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Host: 10.222.0.52 Jun 29 12:40:30.548989 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jun 29 12:40:30.548989 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jun 29 12:40:30.548989 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivEaSW5D-CqEu29RVBGKm9IlqDK1jdGTv6OTojemrW-D2tajaadA5m5XiLrdimXj1PsJ0rWVBy6y3eVdvkOLNkwyWS8hT_HXhLScyJIUV6nVaQgGHeYsf2E4AYFv4d8NTzSuOA6Nv4uz_0tXpA7AfmubyVOX1nTpaDJUy-fSvZ8DINWo Jun 29 12:40:30.548989 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jun 29 12:40:30.548989 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jun 29 12:40:30.548989 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jun 29 12:40:30.548989 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jun 29 12:40:30.548989 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 12:40:30.548989 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jun 29 12:40:30.548989 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jun 29 12:40:30.548989 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Id: 0ed882ae485441db99ccf6109be51b22 Jun 29 12:40:30.548989 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-211799616 Jun 29 12:40:30.548989 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jun 29 12:40:30.548989 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jun 29 12:40:30.550368 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0ed882ae485441db99ccf6109be51b22", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0ed882ae485441db99ccf6109be51b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ed882ae485441db99ccf6109be51b22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ed882ae485441db99ccf6109be51b22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:40:30.550368 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-AttachVolumeShelveTestJSON-211799616 Jun 29 12:40:30.550368 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Id: 0ed882ae485441db99ccf6109be51b22 Jun 29 12:40:30.550368 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-211799616 Jun 29 12:40:30.550368 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User: tempest-AttachVolumeShelveTestJSON-211799616-project Jun 29 12:40:30.550368 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jun 29 12:40:30.550368 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jun 29 12:40:30.550368 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Id: 6252d0519ed9421e89710ca5294524c5 Jun 29 12:40:30.550368 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-AttachVolumeShelveTestJSON-211799616-project Jun 29 12:40:30.550368 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: method: > Jun 29 12:40:30.550368 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: exception: Instance b6005eeb-de9c-4299-85da-6bf176fba2db could not be found. Jun 29 12:40:30.550368 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: action_args: {'id': 'b6005eeb-de9c-4299-85da-6bf176fba2db'} Jun 29 12:40:30.551337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:40:30.551337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:30.551337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:40:30.551337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:40:30.551337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:40:30.551337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:40:30.551337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:40:30.551337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:40:30.551337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:40:30.551337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:40:30.551337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6005eeb-de9c-4299-85da-6bf176fba2db could not be found. Jun 29 12:40:30.551337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:30.551337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:30.551337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:30.551337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:30.551337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:40:30.551337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:40:30.551337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:40:30.551337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:40:30.551337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:40:30.552851 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:40:30.552851 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:40:30.552851 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:40:30.552851 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:40:30.552851 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:40:30.552851 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:40:30.552851 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:40:30.552851 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6005eeb-de9c-4299-85da-6bf176fba2db could not be found. Jun 29 12:40:30.552851 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:30.552851 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:30.552851 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:30.552851 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:30.552851 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:40:30.552851 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:40:30.552851 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:40:30.552851 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:40:30.552851 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6005eeb-de9c-4299-85da-6bf176fba2db could not be found. Jun 29 12:40:30.552851 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:30.554593 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-22faef0d-f96d-4528-a117-d8d30a42cebb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Returning 404 to user: Instance b6005eeb-de9c-4299-85da-6bf176fba2db could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:40:30.554593 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-22faef0d-f96d-4528-a117-d8d30a42cebb tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db" status: 404 len: 111 microversion: 2.20 time: 0.030616 Jun 29 12:40:30.554593 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 372/765] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:40:30 2022] GET /compute/v2.1/servers/b6005eeb-de9c-4299-85da-6bf176fba2db => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 12:40:30.586168 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7d519704-ab46-4113-aa9c-5b32b7d839dc tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:30.594580 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-7d519704-ab46-4113-aa9c-5b32b7d839dc tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00" status: 200 len: 1682 microversion: 2.1 time: 0.161099 Jun 29 12:40:30.595167 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 394/766] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:40:30 2022] GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:40:31.611769 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9f1e1fb8-0563-4677-adde-1738e54a14e5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:31.612392 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-9f1e1fb8-0563-4677-adde-1738e54a14e5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: c8419121-12d7-431e-9ff0-dfa04c64cd00] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:31.619980 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9f1e1fb8-0563-4677-adde-1738e54a14e5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:31.620441 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9f1e1fb8-0563-4677-adde-1738e54a14e5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:31.621226 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9f1e1fb8-0563-4677-adde-1738e54a14e5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:31.621673 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9f1e1fb8-0563-4677-adde-1738e54a14e5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:31.689121 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8a197011-f386-4656-b371-d1ebe08f0e62 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:31.689659 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8a197011-f386-4656-b371-d1ebe08f0e62 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:31.696386 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8a197011-f386-4656-b371-d1ebe08f0e62 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:31.696991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8a197011-f386-4656-b371-d1ebe08f0e62 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:31.697807 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8a197011-f386-4656-b371-d1ebe08f0e62 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:31.698250 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8a197011-f386-4656-b371-d1ebe08f0e62 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:31.713220 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-8a197011-f386-4656-b371-d1ebe08f0e62 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] HTTP exception thrown: Instance d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 could not be found. Jun 29 12:40:31.714999 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8a197011-f386-4656-b371-d1ebe08f0e62 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Request method failure captured: Jun 29 12:40:31.714999 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: DELETE /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 HTTP/1.1 Jun 29 12:40:31.714999 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:40:31.714999 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:40:31.714999 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:40:31.714999 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:40:31.714999 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:40:31.714999 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:40:31.714999 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:40:31.714999 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:40:31.714999 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEaSW5D-CqEu29RVBGKm9IlqDK1jdGTv6OTojemrW-D2tajaadA5m5XiLrdimXj1PsJ0rWVBy6y3eVdvkOLNkwyWS8hT_HXhLScyJIUV6nVaQgGHeYsf2E4AYFv4d8NTzSuOA6Nv4uz_0tXpA7AfmubyVOX1nTpaDJUy-fSvZ8DINWo Jun 29 12:40:31.714999 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:40:31.714999 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:40:31.714999 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:40:31.714999 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:40:31.714999 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 12:40:31.714999 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:40:31.714999 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:40:31.714999 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: 0ed882ae485441db99ccf6109be51b22 Jun 29 12:40:31.714999 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-211799616 Jun 29 12:40:31.714999 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:40:31.714999 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:40:31.716574 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0ed882ae485441db99ccf6109be51b22", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0ed882ae485441db99ccf6109be51b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ed882ae485441db99ccf6109be51b22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ed882ae485441db99ccf6109be51b22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:40:31.716574 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeShelveTestJSON-211799616 Jun 29 12:40:31.716574 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 0ed882ae485441db99ccf6109be51b22 Jun 29 12:40:31.716574 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-211799616 Jun 29 12:40:31.716574 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeShelveTestJSON-211799616-project Jun 29 12:40:31.716574 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:40:31.716574 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:40:31.716574 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: 6252d0519ed9421e89710ca5294524c5 Jun 29 12:40:31.716574 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeShelveTestJSON-211799616-project Jun 29 12:40:31.716574 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:40:31.716574 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Instance d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 could not be found. Jun 29 12:40:31.716574 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': 'd615c3d2-4ba0-41e9-be7e-8e51d8e36b86'} Jun 29 12:40:31.719350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:40:31.719350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:31.719350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:40:31.719350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:40:31.719350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:40:31.719350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:40:31.719350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:40:31.719350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:40:31.719350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:40:31.719350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:40:31.719350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 could not be found. Jun 29 12:40:31.719350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:31.719350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:31.719350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:31.719350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:31.719350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:40:31.719350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:40:31.719350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:40:31.719350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:40:31.719350 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:40:31.720572 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:40:31.720572 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 12:40:31.720572 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 12:40:31.720572 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 12:40:31.720572 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 12:40:31.720572 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:40:31.720572 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:40:31.720572 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:40:31.720572 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:40:31.720572 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 could not be found. Jun 29 12:40:31.720572 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:31.720572 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:31.720572 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:31.720572 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:31.720572 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:40:31.720572 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:40:31.720572 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:40:31.720572 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:40:31.720572 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 could not be found. Jun 29 12:40:31.720572 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:31.721960 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8a197011-f386-4656-b371-d1ebe08f0e62 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Returning 404 to user: Instance d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:40:31.721960 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8a197011-f386-4656-b371-d1ebe08f0e62 tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 404 len: 111 microversion: 2.20 time: 0.031700 Jun 29 12:40:31.721960 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 395/767] 10.222.0.52 () {60 vars in 1279 bytes} [Wed Jun 29 12:40:31 2022] DELETE /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 29 12:40:31.725415 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-875e7c54-4a8f-4546-9314-a7e8a227a2ed tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:31.726027 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-875e7c54-4a8f-4546-9314-a7e8a227a2ed tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] [instance: d615c3d2-4ba0-41e9-be7e-8e51d8e36b86] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:31.732751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-875e7c54-4a8f-4546-9314-a7e8a227a2ed tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:31.733328 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-875e7c54-4a8f-4546-9314-a7e8a227a2ed tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:31.734234 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-875e7c54-4a8f-4546-9314-a7e8a227a2ed tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:31.734844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-875e7c54-4a8f-4546-9314-a7e8a227a2ed tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:31.739567 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:40:31.749297 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9f1e1fb8-0563-4677-adde-1738e54a14e5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:31.751534 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-875e7c54-4a8f-4546-9314-a7e8a227a2ed tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] HTTP exception thrown: Instance d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 could not be found. Jun 29 12:40:31.753241 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-875e7c54-4a8f-4546-9314-a7e8a227a2ed tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Request method failure captured: Jun 29 12:40:31.753241 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 HTTP/1.1 Jun 29 12:40:31.753241 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:40:31.753241 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:40:31.753241 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:40:31.753241 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:40:31.753241 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:40:31.753241 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:40:31.753241 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:40:31.753241 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:40:31.753241 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEaSW5D-CqEu29RVBGKm9IlqDK1jdGTv6OTojemrW-D2tajaadA5m5XiLrdimXj1PsJ0rWVBy6y3eVdvkOLNkwyWS8hT_HXhLScyJIUV6nVaQgGHeYsf2E4AYFv4d8NTzSuOA6Nv4uz_0tXpA7AfmubyVOX1nTpaDJUy-fSvZ8DINWo Jun 29 12:40:31.753241 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:40:31.753241 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:40:31.753241 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:40:31.753241 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:40:31.753241 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 12:40:31.753241 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:40:31.753241 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:40:31.753241 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: 0ed882ae485441db99ccf6109be51b22 Jun 29 12:40:31.753241 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-211799616 Jun 29 12:40:31.753241 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:40:31.753241 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:40:31.754925 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0ed882ae485441db99ccf6109be51b22", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0ed882ae485441db99ccf6109be51b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ed882ae485441db99ccf6109be51b22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0ed882ae485441db99ccf6109be51b22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:40:31.754925 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeShelveTestJSON-211799616 Jun 29 12:40:31.754925 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 0ed882ae485441db99ccf6109be51b22 Jun 29 12:40:31.754925 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-211799616 Jun 29 12:40:31.754925 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeShelveTestJSON-211799616-project Jun 29 12:40:31.754925 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:40:31.754925 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:40:31.754925 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: 6252d0519ed9421e89710ca5294524c5 Jun 29 12:40:31.754925 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeShelveTestJSON-211799616-project Jun 29 12:40:31.754925 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:40:31.754925 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Instance d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 could not be found. Jun 29 12:40:31.754925 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': 'd615c3d2-4ba0-41e9-be7e-8e51d8e36b86'} Jun 29 12:40:31.755880 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:40:31.755880 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:31.755880 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:40:31.755880 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:40:31.755880 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:40:31.755880 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:40:31.755880 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:40:31.755880 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:40:31.755880 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:40:31.755880 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:40:31.755880 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 could not be found. Jun 29 12:40:31.755880 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:31.755880 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:31.755880 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:31.755880 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:31.755880 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:40:31.755880 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:40:31.755880 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:40:31.755880 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:40:31.755880 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:40:31.757282 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:40:31.757282 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:40:31.757282 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:40:31.757282 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:40:31.757282 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:40:31.757282 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:40:31.757282 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:40:31.757282 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 could not be found. Jun 29 12:40:31.757282 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:31.757282 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:31.757282 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:31.757282 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:31.757282 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:40:31.757282 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:40:31.757282 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:40:31.757282 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:40:31.757282 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 could not be found. Jun 29 12:40:31.757282 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:31.758578 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-875e7c54-4a8f-4546-9314-a7e8a227a2ed tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] Returning 404 to user: Instance d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:40:31.758578 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-875e7c54-4a8f-4546-9314-a7e8a227a2ed tempest-AttachVolumeShelveTestJSON-211799616 tempest-AttachVolumeShelveTestJSON-211799616-project] 10.222.0.52 "GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86" status: 404 len: 111 microversion: 2.20 time: 0.034834 Jun 29 12:40:31.762554 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 396/768] 10.222.0.52 () {60 vars in 1276 bytes} [Wed Jun 29 12:40:31 2022] GET /compute/v2.1/servers/d615c3d2-4ba0-41e9-be7e-8e51d8e36b86 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 12:40:31.767682 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9f1e1fb8-0563-4677-adde-1738e54a14e5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00" status: 200 len: 1614 microversion: 2.1 time: 0.158616 Jun 29 12:40:31.768775 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 373/769] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:40:31 2022] GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00 => generated 1614 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:40:31.842591 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-dd11409a-045b-4fc1-9750-47e108dc22d2 req-18cae378-5df0-428c-b821-182781da0871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8419121-12d7-431e-9ff0-dfa04c64cd00", "name": "network-vif-deleted", "tag": "96254a3e-9e71-4d23-acc2-9c889cabe601"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:40:31.854700 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-dd11409a-045b-4fc1-9750-47e108dc22d2 req-18cae378-5df0-428c-b821-182781da0871 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:31.855080 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-dd11409a-045b-4fc1-9750-47e108dc22d2 req-18cae378-5df0-428c-b821-182781da0871 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:31.867464 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-dd11409a-045b-4fc1-9750-47e108dc22d2 req-18cae378-5df0-428c-b821-182781da0871 service nova] Creating event network-vif-deleted:96254a3e-9e71-4d23-acc2-9c889cabe601 for instance c8419121-12d7-431e-9ff0-dfa04c64cd00 on hv-cinder-81268 Jun 29 12:40:31.873149 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-dd11409a-045b-4fc1-9750-47e108dc22d2 req-18cae378-5df0-428c-b821-182781da0871 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034028 Jun 29 12:40:31.877482 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 397/770] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:40:32.785785 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fa58c121-efdb-44a6-894e-259acfd536ac tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:32.786666 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-fa58c121-efdb-44a6-894e-259acfd536ac tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: c8419121-12d7-431e-9ff0-dfa04c64cd00] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:32.792834 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fa58c121-efdb-44a6-894e-259acfd536ac tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:32.793352 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fa58c121-efdb-44a6-894e-259acfd536ac tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:32.794189 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fa58c121-efdb-44a6-894e-259acfd536ac tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:32.794731 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fa58c121-efdb-44a6-894e-259acfd536ac tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:32.809858 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-fa58c121-efdb-44a6-894e-259acfd536ac tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] HTTP exception thrown: Instance c8419121-12d7-431e-9ff0-dfa04c64cd00 could not be found. Jun 29 12:40:32.811730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fa58c121-efdb-44a6-894e-259acfd536ac tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Request method failure captured: Jun 29 12:40:32.811730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00 HTTP/1.1 Jun 29 12:40:32.811730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept: application/json Jun 29 12:40:32.811730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jun 29 12:40:32.811730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Connection: close Jun 29 12:40:32.811730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jun 29 12:40:32.811730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jun 29 12:40:32.811730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Host: 10.222.0.52 Jun 29 12:40:32.811730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jun 29 12:40:32.811730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jun 29 12:40:32.811730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivEe69aM7amLLdDw45pZkO9qxIeRFDOBVDEG3SD63-th4vjx46p2B2ho9vub7AbBeiopTeWWiq0plzI-faJHgEw8JRp3OpSKxo8ZAn9rjDDJbshayaHyBTJQDtsbH4um2iDB62naNRbVeYQvavven9SyQAHp1o14QRaoNvsRRGeWVuWU Jun 29 12:40:32.811730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jun 29 12:40:32.811730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jun 29 12:40:32.811730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jun 29 12:40:32.811730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jun 29 12:40:32.811730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jun 29 12:40:32.811730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jun 29 12:40:32.811730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:40:32.811730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:40:32.811730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jun 29 12:40:32.811730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jun 29 12:40:32.813223 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f18ffa75c23e4276a8b5b4fc3821fb87", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:40:32.813223 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:40:32.813223 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:40:32.813223 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:40:32.813223 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:40:32.813223 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jun 29 12:40:32.813223 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jun 29 12:40:32.813223 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Id: 2af4d4a69e9d4755bff61401f4349c78 Jun 29 12:40:32.813223 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:40:32.813223 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: method: > Jun 29 12:40:32.813223 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: exception: Instance c8419121-12d7-431e-9ff0-dfa04c64cd00 could not be found. Jun 29 12:40:32.813223 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: action_args: {'id': 'c8419121-12d7-431e-9ff0-dfa04c64cd00'} Jun 29 12:40:32.814016 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:40:32.814016 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:32.814016 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:40:32.814016 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:40:32.814016 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:40:32.814016 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:40:32.814016 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:40:32.814016 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:40:32.814016 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:40:32.814016 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:40:32.814016 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8419121-12d7-431e-9ff0-dfa04c64cd00 could not be found. Jun 29 12:40:32.814016 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:32.814016 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:32.814016 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:32.814016 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:32.814016 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:40:32.814016 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:40:32.814016 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:40:32.814016 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:40:32.814016 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:40:32.815723 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:40:32.815723 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:40:32.815723 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:40:32.815723 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:40:32.815723 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:40:32.815723 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:40:32.815723 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:40:32.815723 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8419121-12d7-431e-9ff0-dfa04c64cd00 could not be found. Jun 29 12:40:32.815723 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:32.815723 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:32.815723 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:32.815723 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:32.815723 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:40:32.815723 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:40:32.815723 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:40:32.815723 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:40:32.815723 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8419121-12d7-431e-9ff0-dfa04c64cd00 could not be found. Jun 29 12:40:32.815723 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:32.817025 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fa58c121-efdb-44a6-894e-259acfd536ac tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Returning 404 to user: Instance c8419121-12d7-431e-9ff0-dfa04c64cd00 could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:40:32.817025 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-fa58c121-efdb-44a6-894e-259acfd536ac tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00" status: 404 len: 111 microversion: 2.1 time: 0.031994 Jun 29 12:40:32.817025 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 374/771] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:40:32 2022] GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:40:32.823256 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0dee1a7a-7504-406c-9dcd-c8b26bbff234 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '.version_select at 0x7fdb06903ca0>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:32.845129 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0dee1a7a-7504-406c-9dcd-c8b26bbff234 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1245302347" status: 202 len: 0 microversion: 2.1 time: 0.026003 Jun 29 12:40:32.846248 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 398/772] 10.222.0.52 () {58 vars in 1220 bytes} [Wed Jun 29 12:40:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1245302347 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:40:33.513693 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3e70b1e4-6b7b-4be4-ac7a-ae709f07c842 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Action: 'create', calling method: .version_select at 0x7fdb06a5f040>, body: {"keypair": {"name": "tempest-keypair-583119635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARogHDC12bWsD8xewBIye92TI22dXqMDGH69GzAEm5CSZUFTqtWzDFTMgUMLFpkkSq7cYEk4MjLHzV24w6GA5BV72QYYcgoQDgBfFgVXOCnE8G2KgniYhvo/zy7rM+X9g=="}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:40:33.528801 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-3e70b1e4-6b7b-4be4-ac7a-ae709f07c842 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Getting quotas for project f18ffa75c23e4276a8b5b4fc3821fb87. Resources: {'key_pairs'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:40:33.533380 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-3e70b1e4-6b7b-4be4-ac7a-ae709f07c842 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Getting quotas for user 2af4d4a69e9d4755bff61401f4349c78 and project f18ffa75c23e4276a8b5b4fc3821fb87. Resources: {'key_pairs'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:40:33.555713 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3e70b1e4-6b7b-4be4-ac7a-ae709f07c842 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045949 Jun 29 12:40:33.556650 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 375/773] 10.222.0.52 () {60 vars in 1158 bytes} [Wed Jun 29 12:40:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:40:35.339016 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5dbd6c6e-b4e8-42ff-8670-f0d44bdc2607 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-776667919", "imageRef": "70887696-f652-46b0-a5be-bfb400986078", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a4c9384-2272-4ef8-9e7c-74de83b9d3b0"}], "security_groups": [{"name": "tempest-securitygroup--1877527430"}], "key_name": "tempest-keypair-583119635", "user_data": "}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:40:35.478904 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.network.neutron [None req-5dbd6c6e-b4e8-42ff-8670-f0d44bdc2607 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] validate_networks() for [('9a4c9384-2272-4ef8-9e7c-74de83b9d3b0', None, None, None, None, None)] {{(pid=124317) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 12:40:35.885214 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-5dbd6c6e-b4e8-42ff-8670-f0d44bdc2607 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Flavor limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 12:40:35.885643 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-5dbd6c6e-b4e8-42ff-8670-f0d44bdc2607 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Image limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 12:40:35.886121 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-5dbd6c6e-b4e8-42ff-8670-f0d44bdc2607 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Flavor pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 12:40:35.886589 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-5dbd6c6e-b4e8-42ff-8670-f0d44bdc2607 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Image pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 12:40:35.887004 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-5dbd6c6e-b4e8-42ff-8670-f0d44bdc2607 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 12:40:35.896613 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5dbd6c6e-b4e8-42ff-8670-f0d44bdc2607 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:35.897063 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5dbd6c6e-b4e8-42ff-8670-f0d44bdc2607 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:35.897861 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5dbd6c6e-b4e8-42ff-8670-f0d44bdc2607 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:35.898298 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5dbd6c6e-b4e8-42ff-8670-f0d44bdc2607 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:35.916138 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-5dbd6c6e-b4e8-42ff-8670-f0d44bdc2607 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Getting quotas for project f18ffa75c23e4276a8b5b4fc3821fb87. Resources: {'cores', 'ram', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:40:35.920066 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-5dbd6c6e-b4e8-42ff-8670-f0d44bdc2607 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Getting quotas for user 2af4d4a69e9d4755bff61401f4349c78 and project f18ffa75c23e4276a8b5b4fc3821fb87. Resources: {'cores', 'ram', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:40:35.931690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5dbd6c6e-b4e8-42ff-8670-f0d44bdc2607 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Going to run 1 instances... {{(pid=124317) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 12:40:35.934051 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5dbd6c6e-b4e8-42ff-8670-f0d44bdc2607 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d0e0d99d-35d9-455b-944d-3468780b7ec0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70887696-f652-46b0-a5be-bfb400986078',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124317) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 12:40:35.981956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5dbd6c6e-b4e8-42ff-8670-f0d44bdc2607 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.648004 Jun 29 12:40:35.983173 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 399/774] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 12:40:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 12:40:35.993835 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8188127b-8c08-41b4-94f1-e241a734278e tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:35.995073 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8188127b-8c08-41b4-94f1-e241a734278e tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d0e0d99d-35d9-455b-944d-3468780b7ec0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:36.063567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8188127b-8c08-41b4-94f1-e241a734278e tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:36.072043 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8188127b-8c08-41b4-94f1-e241a734278e tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0" status: 200 len: 1240 microversion: 2.1 time: 0.082011 Jun 29 12:40:36.073330 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 376/775] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:40:35 2022] GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:40:36.934162 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-52e6e3b7-5792-4350-8df4-13b88ee559fd tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] Action: 'create', calling method: .version_select at 0x7fdb06a6c700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1331685506"}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:40:37.090012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-874b4d14-4e45-4076-bb27-d79a6bec04cc tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:37.090656 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-874b4d14-4e45-4076-bb27-d79a6bec04cc tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d0e0d99d-35d9-455b-944d-3468780b7ec0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:37.098052 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-874b4d14-4e45-4076-bb27-d79a6bec04cc tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:37.098550 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-874b4d14-4e45-4076-bb27-d79a6bec04cc tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:37.099337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-874b4d14-4e45-4076-bb27-d79a6bec04cc tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:37.099785 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-874b4d14-4e45-4076-bb27-d79a6bec04cc tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:37.104050 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:40:37.172884 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-874b4d14-4e45-4076-bb27-d79a6bec04cc tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:37.182625 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-874b4d14-4e45-4076-bb27-d79a6bec04cc tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0" status: 200 len: 1298 microversion: 2.1 time: 0.095595 Jun 29 12:40:37.183208 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 377/776] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:40:37 2022] GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0 => generated 1298 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:40:37.267738 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-52e6e3b7-5792-4350-8df4-13b88ee559fd tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.459508 Jun 29 12:40:37.268625 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 400/777] 10.222.0.52 () {60 vars in 1154 bytes} [Wed Jun 29 12:40:36 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 461 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 29 12:40:37.279474 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-cd93fe05-d772-4ac3-b6de-e8271557c70a tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] Calling method '.version_select at 0x7fdb091e78b0>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:37.335600 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-cd93fe05-d772-4ac3-b6de-e8271557c70a tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/e9dc844d-a663-4ff2-a318-0d9d0ed07fb1" status: 200 len: 345 microversion: 2.1 time: 0.059793 Jun 29 12:40:37.336194 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 378/778] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 12:40:37 2022] GET /compute/v2.1/os-volumes/e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:40:38.200649 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ea8dc367-cba9-447d-8ecf-899ffd6615c5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:38.201701 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ea8dc367-cba9-447d-8ecf-899ffd6615c5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d0e0d99d-35d9-455b-944d-3468780b7ec0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:38.210981 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ea8dc367-cba9-447d-8ecf-899ffd6615c5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:38.211678 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ea8dc367-cba9-447d-8ecf-899ffd6615c5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:38.212450 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ea8dc367-cba9-447d-8ecf-899ffd6615c5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:38.212882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ea8dc367-cba9-447d-8ecf-899ffd6615c5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:38.349125 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-7af436b6-d802-4b76-bbd1-2e488f821503 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] Calling method '.version_select at 0x7fdb06892dc0>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:38.385664 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ea8dc367-cba9-447d-8ecf-899ffd6615c5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:38.396109 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ea8dc367-cba9-447d-8ecf-899ffd6615c5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0" status: 200 len: 1366 microversion: 2.1 time: 0.199497 Jun 29 12:40:38.404104 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 401/779] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:40:38 2022] GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:40:38.417607 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-55ce90bb-42fa-4360-bb5e-7ccc070c82c8 req-bda73a24-d7d5-4b61-9d39-a0ce7c4ab54a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0e0d99d-35d9-455b-944d-3468780b7ec0", "tag": "ba2f4f8f-721b-4ca9-baa6-9503942c77a9"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:40:38.433760 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-55ce90bb-42fa-4360-bb5e-7ccc070c82c8 req-bda73a24-d7d5-4b61-9d39-a0ce7c4ab54a service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:38.434580 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-55ce90bb-42fa-4360-bb5e-7ccc070c82c8 req-bda73a24-d7d5-4b61-9d39-a0ce7c4ab54a service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:38.438508 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-7af436b6-d802-4b76-bbd1-2e488f821503 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/e9dc844d-a663-4ff2-a318-0d9d0ed07fb1" status: 200 len: 346 microversion: 2.1 time: 0.094226 Jun 29 12:40:38.440071 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 379/780] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 12:40:38 2022] GET /compute/v2.1/os-volumes/e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 => generated 346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:40:38.450542 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-53a2a8a6-6964-4c67-8904-bd5e9c5332b2 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] Action: 'create', calling method: .version_select at 0x7fdb0681c040>, body: {"snapshot": {"volume_id": "e9dc844d-a663-4ff2-a318-0d9d0ed07fb1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-72888487"}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:40:38.460116 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-55ce90bb-42fa-4360-bb5e-7ccc070c82c8 req-bda73a24-d7d5-4b61-9d39-a0ce7c4ab54a service nova] Creating event network-changed:ba2f4f8f-721b-4ca9-baa6-9503942c77a9 for instance d0e0d99d-35d9-455b-944d-3468780b7ec0 on hv-cinder-81268 Jun 29 12:40:38.465497 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-55ce90bb-42fa-4360-bb5e-7ccc070c82c8 req-bda73a24-d7d5-4b61-9d39-a0ce7c4ab54a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059532 Jun 29 12:40:38.466532 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 402/781] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:40:38.623694 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-53a2a8a6-6964-4c67-8904-bd5e9c5332b2 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.176759 Jun 29 12:40:38.626500 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 380/782] 10.222.0.52 () {60 vars in 1161 bytes} [Wed Jun 29 12:40:38 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:40:38.635266 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-46bd881d-aac8-4938-8c0a-fef92f917913 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] Calling method '.version_select at 0x7fdb06901f70>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:38.668488 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-46bd881d-aac8-4938-8c0a-fef92f917913 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/76bc68b5-8282-463c-b346-bb971dbf33c5" status: 200 len: 285 microversion: 2.1 time: 0.037265 Jun 29 12:40:38.669094 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 403/783] 10.222.0.52 () {58 vars in 1250 bytes} [Wed Jun 29 12:40:38 2022] GET /compute/v2.1/os-snapshots/76bc68b5-8282-463c-b346-bb971dbf33c5 => generated 285 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:40:38.679125 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-40ed895d-9e2a-44df-acb8-576f3c0a08ee tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] Calling method '.version_select at 0x7fdb0680d940>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:38.710069 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-40ed895d-9e2a-44df-acb8-576f3c0a08ee tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.034672 Jun 29 12:40:38.710762 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 381/784] 10.222.0.52 () {58 vars in 1139 bytes} [Wed Jun 29 12:40:38 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:40:38.720628 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6daed28e-c9fb-4c9a-a053-1171be1bb5f7 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] Calling method '.version_select at 0x7fdb06903550>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:38.750656 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6daed28e-c9fb-4c9a-a053-1171be1bb5f7 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/76bc68b5-8282-463c-b346-bb971dbf33c5" status: 200 len: 285 microversion: 2.1 time: 0.032948 Jun 29 12:40:38.751500 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 404/785] 10.222.0.52 () {58 vars in 1250 bytes} [Wed Jun 29 12:40:38 2022] GET /compute/v2.1/os-snapshots/76bc68b5-8282-463c-b346-bb971dbf33c5 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:40:39.413510 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-83fabfed-a66d-4532-8824-18b663078b61 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:39.414124 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-83fabfed-a66d-4532-8824-18b663078b61 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d0e0d99d-35d9-455b-944d-3468780b7ec0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:39.420274 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-83fabfed-a66d-4532-8824-18b663078b61 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:39.420733 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-83fabfed-a66d-4532-8824-18b663078b61 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:39.422126 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-83fabfed-a66d-4532-8824-18b663078b61 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:39.422604 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-83fabfed-a66d-4532-8824-18b663078b61 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:39.547702 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-83fabfed-a66d-4532-8824-18b663078b61 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:39.555100 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-83fabfed-a66d-4532-8824-18b663078b61 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0" status: 200 len: 1366 microversion: 2.1 time: 0.145936 Jun 29 12:40:39.555657 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 382/786] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:40:39 2022] GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:40:39.762905 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1c916b13-367c-49da-b171-3fe9e0515524 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] Calling method '.version_select at 0x7fdb06851940>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:39.793566 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1c916b13-367c-49da-b171-3fe9e0515524 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/76bc68b5-8282-463c-b346-bb971dbf33c5" status: 200 len: 285 microversion: 2.1 time: 0.034872 Jun 29 12:40:39.794124 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 405/787] 10.222.0.52 () {58 vars in 1250 bytes} [Wed Jun 29 12:40:39 2022] GET /compute/v2.1/os-snapshots/76bc68b5-8282-463c-b346-bb971dbf33c5 => generated 285 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:40:40.571935 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-036bf0fa-3861-4384-877c-9642a338003b tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:40.572540 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-036bf0fa-3861-4384-877c-9642a338003b tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d0e0d99d-35d9-455b-944d-3468780b7ec0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:40.579065 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-036bf0fa-3861-4384-877c-9642a338003b tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:40.579509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-036bf0fa-3861-4384-877c-9642a338003b tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:40.580259 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-036bf0fa-3861-4384-877c-9642a338003b tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:40.580689 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-036bf0fa-3861-4384-877c-9642a338003b tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:40.718635 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-036bf0fa-3861-4384-877c-9642a338003b tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:40.726216 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-036bf0fa-3861-4384-877c-9642a338003b tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0" status: 200 len: 1366 microversion: 2.1 time: 0.158169 Jun 29 12:40:40.726799 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 383/788] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:40:40 2022] GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:40:40.805724 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-dc8290d8-c8b8-46d8-adc0-e41684f6866a tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] Calling method '.version_select at 0x7fdb068829d0>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:40.835620 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-dc8290d8-c8b8-46d8-adc0-e41684f6866a tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/76bc68b5-8282-463c-b346-bb971dbf33c5" status: 200 len: 285 microversion: 2.1 time: 0.034132 Jun 29 12:40:40.836172 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 406/789] 10.222.0.52 () {58 vars in 1250 bytes} [Wed Jun 29 12:40:40 2022] GET /compute/v2.1/os-snapshots/76bc68b5-8282-463c-b346-bb971dbf33c5 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:40:41.744208 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5e9a3092-add3-4e15-aa50-4f4c45119905 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:41.744743 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5e9a3092-add3-4e15-aa50-4f4c45119905 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d0e0d99d-35d9-455b-944d-3468780b7ec0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:41.746991 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:40:41.752845 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5e9a3092-add3-4e15-aa50-4f4c45119905 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:41.753289 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5e9a3092-add3-4e15-aa50-4f4c45119905 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:41.754047 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5e9a3092-add3-4e15-aa50-4f4c45119905 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:41.754503 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5e9a3092-add3-4e15-aa50-4f4c45119905 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:41.849484 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-28c33614-b90c-4667-82cc-49384f44553d tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] Calling method '.version_select at 0x7fdb06954790>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:41.879837 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-28c33614-b90c-4667-82cc-49384f44553d tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/76bc68b5-8282-463c-b346-bb971dbf33c5" status: 200 len: 286 microversion: 2.1 time: 0.034929 Jun 29 12:40:41.880394 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 407/790] 10.222.0.52 () {58 vars in 1250 bytes} [Wed Jun 29 12:40:41 2022] GET /compute/v2.1/os-snapshots/76bc68b5-8282-463c-b346-bb971dbf33c5 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:40:41.887997 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5e9a3092-add3-4e15-aa50-4f4c45119905 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:41.891056 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-229bb2fe-f8e3-4aee-bb1b-a7afe87bacb3 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] Calling method '.version_select at 0x7fdb069035e0>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:41.896339 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5e9a3092-add3-4e15-aa50-4f4c45119905 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0" status: 200 len: 1366 microversion: 2.1 time: 0.156076 Jun 29 12:40:41.897090 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 384/791] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:40:41 2022] GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:40:41.946597 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-229bb2fe-f8e3-4aee-bb1b-a7afe87bacb3 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/76bc68b5-8282-463c-b346-bb971dbf33c5" status: 202 len: 0 microversion: 2.1 time: 0.059824 Jun 29 12:40:41.947153 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 408/792] 10.222.0.52 () {58 vars in 1253 bytes} [Wed Jun 29 12:40:41 2022] DELETE /compute/v2.1/os-snapshots/76bc68b5-8282-463c-b346-bb971dbf33c5 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 29 12:40:41.956143 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ce682049-1949-4393-b289-cb047da2c2ff tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] Calling method '.version_select at 0x7fdb068921f0>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:41.985712 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ce682049-1949-4393-b289-cb047da2c2ff tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/76bc68b5-8282-463c-b346-bb971dbf33c5" status: 200 len: 285 microversion: 2.1 time: 0.033906 Jun 29 12:40:41.986277 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 385/793] 10.222.0.52 () {58 vars in 1250 bytes} [Wed Jun 29 12:40:41 2022] GET /compute/v2.1/os-snapshots/76bc68b5-8282-463c-b346-bb971dbf33c5 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:40:42.913480 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c0594b55-b6a3-46db-be21-d2dc633fbf4d tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:42.914207 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c0594b55-b6a3-46db-be21-d2dc633fbf4d tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d0e0d99d-35d9-455b-944d-3468780b7ec0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:42.916192 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:40:42.923079 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c0594b55-b6a3-46db-be21-d2dc633fbf4d tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:42.923534 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c0594b55-b6a3-46db-be21-d2dc633fbf4d tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:42.924422 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c0594b55-b6a3-46db-be21-d2dc633fbf4d tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:42.925078 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c0594b55-b6a3-46db-be21-d2dc633fbf4d tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:42.998015 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-49a4ee89-6894-4f3b-acf9-ad4e9336e681 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] Calling method '.version_select at 0x7fdb0681c700>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:43.023757 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-49a4ee89-6894-4f3b-acf9-ad4e9336e681 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] HTTP exception thrown: Snapshot 76bc68b5-8282-463c-b346-bb971dbf33c5 could not be found. Jun 29 12:40:43.026439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-49a4ee89-6894-4f3b-acf9-ad4e9336e681 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] Request method failure captured: Jun 29 12:40:43.026439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/os-snapshots/76bc68b5-8282-463c-b346-bb971dbf33c5 HTTP/1.1 Jun 29 12:40:43.026439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept: application/json Jun 29 12:40:43.026439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jun 29 12:40:43.026439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Connection: close Jun 29 12:40:43.026439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jun 29 12:40:43.026439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jun 29 12:40:43.026439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Host: 10.222.0.52 Jun 29 12:40:43.026439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jun 29 12:40:43.026439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jun 29 12:40:43.026439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivEhEuZbysrBgCRtAfAKnp0if0eIJnq4PUt4hkPmTUg4pgSOMIi765vz_S_sR6PbNF1aaOvUHvGBS_XQoM8Rk6M3uXF0Yy1yzJV8NsSYYFNsj2UPzOINKz1HFrOZn6spAjHkF-9GPAIYdEaDzx-jQGLz5qy_uQaky8m6JkU5bzltWKRg Jun 29 12:40:43.026439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jun 29 12:40:43.026439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jun 29 12:40:43.026439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jun 29 12:40:43.026439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jun 29 12:40:43.026439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jun 29 12:40:43.026439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jun 29 12:40:43.026439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Id: a485b1538d984e1680e8360a5060bd8e Jun 29 12:40:43.026439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-533208371 Jun 29 12:40:43.026439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jun 29 12:40:43.026439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jun 29 12:40:43.027807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a485b1538d984e1680e8360a5060bd8e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a485b1538d984e1680e8360a5060bd8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a485b1538d984e1680e8360a5060bd8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a485b1538d984e1680e8360a5060bd8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:40:43.027807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-VolumesSnapshotsTestJSON-533208371 Jun 29 12:40:43.027807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Id: a485b1538d984e1680e8360a5060bd8e Jun 29 12:40:43.027807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-533208371 Jun 29 12:40:43.027807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User: tempest-VolumesSnapshotsTestJSON-533208371-project Jun 29 12:40:43.027807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jun 29 12:40:43.027807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jun 29 12:40:43.027807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Id: 1eff347abf6b4362971126adb984ad16 Jun 29 12:40:43.027807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-VolumesSnapshotsTestJSON-533208371-project Jun 29 12:40:43.027807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: method: Jun 29 12:40:43.027807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: exception: Snapshot 76bc68b5-8282-463c-b346-bb971dbf33c5 could not be found. Jun 29 12:40:43.027807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: action_args: {'id': '76bc68b5-8282-463c-b346-bb971dbf33c5'} Jun 29 12:40:43.027807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:40:43.028684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:43.028684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 29 12:40:43.028684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 29 12:40:43.028684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 29 12:40:43.028684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 29 12:40:43.028684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 29 12:40:43.028684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 29 12:40:43.028684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 12:40:43.028684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 12:40:43.028684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 12:40:43.028684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 12:40:43.028684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 12:40:43.028684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 12:40:43.028684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 12:40:43.028684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 12:40:43.028684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 76bc68b5-8282-463c-b346-bb971dbf33c5 could not be found. (HTTP 404) (Request-ID: req-38d2bf57-8c04-412a-8b01-03917f8bbde1) Jun 29 12:40:43.028684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:43.028684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:43.029827 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:43.029827 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:43.029827 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 29 12:40:43.029827 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 29 12:40:43.029827 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 12:40:43.029827 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 12:40:43.029827 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 29 12:40:43.029827 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 29 12:40:43.029827 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 12:40:43.029827 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 12:40:43.029827 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 29 12:40:43.029827 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 29 12:40:43.029827 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 29 12:40:43.029827 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 29 12:40:43.029827 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 29 12:40:43.029827 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 29 12:40:43.029827 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 12:40:43.029827 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 12:40:43.029827 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 12:40:43.031668 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 12:40:43.031668 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 12:40:43.031668 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 12:40:43.031668 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 12:40:43.031668 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 12:40:43.031668 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 76bc68b5-8282-463c-b346-bb971dbf33c5 could not be found. Jun 29 12:40:43.031668 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:43.031668 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:43.031668 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:43.031668 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:43.031668 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:40:43.031668 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:40:43.031668 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:40:43.031668 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:40:43.031668 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 12:40:43.031668 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 12:40:43.031668 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:40:43.031668 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:40:43.031668 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 29 12:40:43.031668 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:40:43.032864 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 76bc68b5-8282-463c-b346-bb971dbf33c5 could not be found. Jun 29 12:40:43.032864 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:43.032864 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:43.032864 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:43.032864 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:43.032864 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:40:43.032864 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:40:43.032864 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:40:43.032864 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:40:43.032864 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 76bc68b5-8282-463c-b346-bb971dbf33c5 could not be found. Jun 29 12:40:43.032864 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:43.035319 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-49a4ee89-6894-4f3b-acf9-ad4e9336e681 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] Returning 404 to user: Snapshot 76bc68b5-8282-463c-b346-bb971dbf33c5 could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:40:43.036642 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-49a4ee89-6894-4f3b-acf9-ad4e9336e681 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/76bc68b5-8282-463c-b346-bb971dbf33c5" status: 404 len: 111 microversion: 2.1 time: 0.043052 Jun 29 12:40:43.037447 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 386/794] 10.222.0.52 () {58 vars in 1250 bytes} [Wed Jun 29 12:40:42 2022] GET /compute/v2.1/os-snapshots/76bc68b5-8282-463c-b346-bb971dbf33c5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 12:40:43.046022 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9fbdd126-0c0f-46ba-8e4e-71521d2b4d0d tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] Calling method '.version_select at 0x7fdb06a1e550>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:43.065240 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c0594b55-b6a3-46db-be21-d2dc633fbf4d tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:43.072977 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c0594b55-b6a3-46db-be21-d2dc633fbf4d tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0" status: 200 len: 1366 microversion: 2.1 time: 0.163691 Jun 29 12:40:43.074458 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 409/795] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:40:42 2022] GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:40:43.110446 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9fbdd126-0c0f-46ba-8e4e-71521d2b4d0d tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/e9dc844d-a663-4ff2-a318-0d9d0ed07fb1" status: 202 len: 0 microversion: 2.1 time: 0.068663 Jun 29 12:40:43.111029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 387/796] 10.222.0.52 () {58 vars in 1247 bytes} [Wed Jun 29 12:40:43 2022] DELETE /compute/v2.1/os-volumes/e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 29 12:40:43.119647 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-27cd4628-269f-4c6a-ae40-cd56f7307b67 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] Calling method '.version_select at 0x7fdb06851430>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:43.171631 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-27cd4628-269f-4c6a-ae40-cd56f7307b67 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/e9dc844d-a663-4ff2-a318-0d9d0ed07fb1" status: 200 len: 345 microversion: 2.1 time: 0.056153 Jun 29 12:40:43.176061 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 410/797] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 12:40:43 2022] GET /compute/v2.1/os-volumes/e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:40:44.090949 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0760014e-9064-4e0b-b874-898783ea7630 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:44.091553 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0760014e-9064-4e0b-b874-898783ea7630 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d0e0d99d-35d9-455b-944d-3468780b7ec0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:44.098602 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0760014e-9064-4e0b-b874-898783ea7630 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:44.099053 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0760014e-9064-4e0b-b874-898783ea7630 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:44.099808 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0760014e-9064-4e0b-b874-898783ea7630 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:44.100247 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0760014e-9064-4e0b-b874-898783ea7630 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:44.188588 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9041209c-95cf-4425-9207-4a019559edc0 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] Calling method '.version_select at 0x7fdb06882b80>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:44.216357 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-9041209c-95cf-4425-9207-4a019559edc0 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] HTTP exception thrown: Volume e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 could not be found. Jun 29 12:40:44.219800 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9041209c-95cf-4425-9207-4a019559edc0 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] Request method failure captured: Jun 29 12:40:44.219800 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/os-volumes/e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 HTTP/1.1 Jun 29 12:40:44.219800 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:40:44.219800 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:40:44.219800 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:40:44.219800 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:40:44.219800 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:40:44.219800 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:40:44.219800 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:40:44.219800 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:40:44.219800 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEhEuZbysrBgCRtAfAKnp0if0eIJnq4PUt4hkPmTUg4pgSOMIi765vz_S_sR6PbNF1aaOvUHvGBS_XQoM8Rk6M3uXF0Yy1yzJV8NsSYYFNsj2UPzOINKz1HFrOZn6spAjHkF-9GPAIYdEaDzx-jQGLz5qy_uQaky8m6JkU5bzltWKRg Jun 29 12:40:44.219800 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:40:44.219800 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:40:44.219800 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:40:44.219800 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:40:44.219800 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:40:44.219800 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:40:44.219800 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: a485b1538d984e1680e8360a5060bd8e Jun 29 12:40:44.219800 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-533208371 Jun 29 12:40:44.219800 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:40:44.219800 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:40:44.221209 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a485b1538d984e1680e8360a5060bd8e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a485b1538d984e1680e8360a5060bd8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a485b1538d984e1680e8360a5060bd8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a485b1538d984e1680e8360a5060bd8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:40:44.221209 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-VolumesSnapshotsTestJSON-533208371 Jun 29 12:40:44.221209 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: a485b1538d984e1680e8360a5060bd8e Jun 29 12:40:44.221209 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-533208371 Jun 29 12:40:44.221209 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-VolumesSnapshotsTestJSON-533208371-project Jun 29 12:40:44.221209 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:40:44.221209 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:40:44.221209 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: 1eff347abf6b4362971126adb984ad16 Jun 29 12:40:44.221209 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-VolumesSnapshotsTestJSON-533208371-project Jun 29 12:40:44.221209 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: Jun 29 12:40:44.221209 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Volume e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 could not be found. Jun 29 12:40:44.221209 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': 'e9dc844d-a663-4ff2-a318-0d9d0ed07fb1'} Jun 29 12:40:44.221209 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:40:44.222073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:44.222073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 12:40:44.222073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 12:40:44.222073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 12:40:44.222073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 12:40:44.222073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 12:40:44.222073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 12:40:44.222073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 12:40:44.222073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 12:40:44.222073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 12:40:44.222073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 12:40:44.222073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 12:40:44.222073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 12:40:44.222073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 12:40:44.222073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 12:40:44.222073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 could not be found. (HTTP 404) (Request-ID: req-e4901b4b-61ad-455c-82e7-49060f28ebec) Jun 29 12:40:44.222073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:44.222073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:44.222073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:44.223288 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:44.223288 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 29 12:40:44.223288 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 29 12:40:44.223288 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 12:40:44.223288 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 12:40:44.223288 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 12:40:44.223288 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 12:40:44.223288 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 12:40:44.223288 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 12:40:44.223288 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 12:40:44.223288 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 12:40:44.223288 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 12:40:44.223288 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 12:40:44.223288 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 12:40:44.223288 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 12:40:44.223288 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 12:40:44.223288 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 12:40:44.223288 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 12:40:44.223288 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 12:40:44.224709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 12:40:44.224709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 12:40:44.224709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 12:40:44.224709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 12:40:44.224709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 could not be found. Jun 29 12:40:44.224709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:44.224709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:44.224709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:44.224709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:44.224709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:40:44.224709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:40:44.224709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:40:44.224709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:40:44.224709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 12:40:44.224709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 12:40:44.224709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:40:44.224709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:40:44.224709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 29 12:40:44.224709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:40:44.225837 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 could not be found. Jun 29 12:40:44.225837 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:44.225837 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:44.225837 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:44.225837 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:44.225837 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:40:44.225837 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:40:44.225837 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:40:44.225837 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:40:44.225837 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 could not be found. Jun 29 12:40:44.225837 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:44.225837 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9041209c-95cf-4425-9207-4a019559edc0 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] Returning 404 to user: Volume e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:40:44.225837 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-9041209c-95cf-4425-9207-4a019559edc0 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/e9dc844d-a663-4ff2-a318-0d9d0ed07fb1" status: 404 len: 109 microversion: 2.1 time: 0.036993 Jun 29 12:40:44.225837 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 411/798] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 12:40:44 2022] GET /compute/v2.1/os-volumes/e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 12:40:44.236665 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e1f6b8da-056d-4f72-99a8-0c13a8576d89 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] Calling method '.version_select at 0x7fdb06954b80>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:44.245425 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0760014e-9064-4e0b-b874-898783ea7630 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:44.253680 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0760014e-9064-4e0b-b874-898783ea7630 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0" status: 200 len: 1366 microversion: 2.1 time: 0.167111 Jun 29 12:40:44.254242 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 388/799] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:40:44 2022] GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:40:44.263656 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-e1f6b8da-056d-4f72-99a8-0c13a8576d89 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] HTTP exception thrown: Volume e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 could not be found. Jun 29 12:40:44.266247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e1f6b8da-056d-4f72-99a8-0c13a8576d89 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] Request method failure captured: Jun 29 12:40:44.266247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: DELETE /compute/v2.1/os-volumes/e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 HTTP/1.1 Jun 29 12:40:44.266247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:40:44.266247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:40:44.266247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:40:44.266247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:40:44.266247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:40:44.266247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:40:44.266247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:40:44.266247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:40:44.266247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEhEuZbysrBgCRtAfAKnp0if0eIJnq4PUt4hkPmTUg4pgSOMIi765vz_S_sR6PbNF1aaOvUHvGBS_XQoM8Rk6M3uXF0Yy1yzJV8NsSYYFNsj2UPzOINKz1HFrOZn6spAjHkF-9GPAIYdEaDzx-jQGLz5qy_uQaky8m6JkU5bzltWKRg Jun 29 12:40:44.266247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:40:44.266247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:40:44.266247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:40:44.266247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:40:44.266247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:40:44.266247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:40:44.266247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: a485b1538d984e1680e8360a5060bd8e Jun 29 12:40:44.266247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-533208371 Jun 29 12:40:44.266247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:40:44.266247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:40:44.267959 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a485b1538d984e1680e8360a5060bd8e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a485b1538d984e1680e8360a5060bd8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a485b1538d984e1680e8360a5060bd8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a485b1538d984e1680e8360a5060bd8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:40:44.267959 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-VolumesSnapshotsTestJSON-533208371 Jun 29 12:40:44.267959 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: a485b1538d984e1680e8360a5060bd8e Jun 29 12:40:44.267959 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-533208371 Jun 29 12:40:44.267959 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-VolumesSnapshotsTestJSON-533208371-project Jun 29 12:40:44.267959 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:40:44.267959 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:40:44.267959 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: 1eff347abf6b4362971126adb984ad16 Jun 29 12:40:44.267959 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-VolumesSnapshotsTestJSON-533208371-project Jun 29 12:40:44.267959 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: Jun 29 12:40:44.267959 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Volume e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 could not be found. Jun 29 12:40:44.267959 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': 'e9dc844d-a663-4ff2-a318-0d9d0ed07fb1'} Jun 29 12:40:44.267959 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:40:44.268947 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:44.268947 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 12:40:44.268947 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 12:40:44.268947 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 12:40:44.268947 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 12:40:44.268947 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 12:40:44.268947 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 12:40:44.268947 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 12:40:44.268947 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 12:40:44.268947 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 12:40:44.268947 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 12:40:44.268947 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 12:40:44.268947 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 12:40:44.268947 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 12:40:44.268947 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 12:40:44.268947 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 could not be found. (HTTP 404) (Request-ID: req-25a09848-7c62-4bfc-acb0-52e8d5ca66b2) Jun 29 12:40:44.268947 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:44.268947 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:44.268947 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:44.270694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:44.270694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 29 12:40:44.270694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 29 12:40:44.270694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 12:40:44.270694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 12:40:44.270694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 12:40:44.270694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 12:40:44.270694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 12:40:44.270694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 12:40:44.270694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 12:40:44.270694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 12:40:44.270694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 12:40:44.270694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 12:40:44.270694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 12:40:44.270694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 12:40:44.270694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 12:40:44.270694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 12:40:44.270694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 12:40:44.270694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 12:40:44.272055 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 12:40:44.272055 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 12:40:44.272055 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 12:40:44.272055 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 12:40:44.272055 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 could not be found. Jun 29 12:40:44.272055 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:44.272055 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:44.272055 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:44.272055 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:44.272055 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:40:44.272055 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:40:44.272055 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:40:44.272055 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:40:44.272055 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 12:40:44.272055 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 12:40:44.272055 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:40:44.272055 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:40:44.272055 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 29 12:40:44.272055 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:40:44.273534 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 could not be found. Jun 29 12:40:44.273534 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:44.273534 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:44.273534 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:44.273534 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:44.273534 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:40:44.273534 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:40:44.273534 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:40:44.273534 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:40:44.273534 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 could not be found. Jun 29 12:40:44.273534 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:40:44.273534 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e1f6b8da-056d-4f72-99a8-0c13a8576d89 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] Returning 404 to user: Volume e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:40:44.273534 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e1f6b8da-056d-4f72-99a8-0c13a8576d89 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/e9dc844d-a663-4ff2-a318-0d9d0ed07fb1" status: 404 len: 109 microversion: 2.1 time: 0.036426 Jun 29 12:40:44.273534 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 412/800] 10.222.0.52 () {58 vars in 1247 bytes} [Wed Jun 29 12:40:44 2022] DELETE /compute/v2.1/os-volumes/e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 12:40:44.276196 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d72c0491-1a45-47dd-895e-f1229b495054 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] Calling method '.version_select at 0x7fdb067d6820>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:44.303329 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-d72c0491-1a45-47dd-895e-f1229b495054 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] HTTP exception thrown: Volume e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 could not be found. Jun 29 12:40:44.305270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d72c0491-1a45-47dd-895e-f1229b495054 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] Request method failure captured: Jun 29 12:40:44.305270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/os-volumes/e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 HTTP/1.1 Jun 29 12:40:44.305270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept: application/json Jun 29 12:40:44.305270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jun 29 12:40:44.305270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Connection: close Jun 29 12:40:44.305270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jun 29 12:40:44.305270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jun 29 12:40:44.305270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Host: 10.222.0.52 Jun 29 12:40:44.305270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jun 29 12:40:44.305270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jun 29 12:40:44.305270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivEhEuZbysrBgCRtAfAKnp0if0eIJnq4PUt4hkPmTUg4pgSOMIi765vz_S_sR6PbNF1aaOvUHvGBS_XQoM8Rk6M3uXF0Yy1yzJV8NsSYYFNsj2UPzOINKz1HFrOZn6spAjHkF-9GPAIYdEaDzx-jQGLz5qy_uQaky8m6JkU5bzltWKRg Jun 29 12:40:44.305270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jun 29 12:40:44.305270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jun 29 12:40:44.305270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jun 29 12:40:44.305270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jun 29 12:40:44.305270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jun 29 12:40:44.305270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jun 29 12:40:44.305270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Id: a485b1538d984e1680e8360a5060bd8e Jun 29 12:40:44.305270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-533208371 Jun 29 12:40:44.305270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jun 29 12:40:44.305270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jun 29 12:40:44.306897 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a485b1538d984e1680e8360a5060bd8e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a485b1538d984e1680e8360a5060bd8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a485b1538d984e1680e8360a5060bd8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a485b1538d984e1680e8360a5060bd8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:40:44.306897 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-VolumesSnapshotsTestJSON-533208371 Jun 29 12:40:44.306897 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Id: a485b1538d984e1680e8360a5060bd8e Jun 29 12:40:44.306897 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-533208371 Jun 29 12:40:44.306897 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User: tempest-VolumesSnapshotsTestJSON-533208371-project Jun 29 12:40:44.306897 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jun 29 12:40:44.306897 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jun 29 12:40:44.306897 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Id: 1eff347abf6b4362971126adb984ad16 Jun 29 12:40:44.306897 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-VolumesSnapshotsTestJSON-533208371-project Jun 29 12:40:44.306897 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: method: Jun 29 12:40:44.306897 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: exception: Volume e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 could not be found. Jun 29 12:40:44.306897 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: action_args: {'id': 'e9dc844d-a663-4ff2-a318-0d9d0ed07fb1'} Jun 29 12:40:44.306897 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:40:44.307806 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:44.307806 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 12:40:44.307806 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 12:40:44.307806 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 12:40:44.307806 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 12:40:44.307806 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 12:40:44.307806 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 12:40:44.307806 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 12:40:44.307806 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 12:40:44.307806 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 12:40:44.307806 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 12:40:44.307806 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 12:40:44.307806 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 12:40:44.307806 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 12:40:44.307806 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 12:40:44.307806 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 could not be found. (HTTP 404) (Request-ID: req-3b9fc109-1d79-4001-9d54-a6ca81042f54) Jun 29 12:40:44.307806 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:44.307806 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:44.307806 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:44.309244 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:44.309244 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 29 12:40:44.309244 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 29 12:40:44.309244 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 12:40:44.309244 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 12:40:44.309244 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 12:40:44.309244 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 12:40:44.309244 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 12:40:44.309244 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 12:40:44.309244 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 12:40:44.309244 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 12:40:44.309244 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 12:40:44.309244 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 12:40:44.309244 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 12:40:44.309244 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 12:40:44.309244 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 12:40:44.309244 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 12:40:44.309244 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 12:40:44.309244 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 12:40:44.310704 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 12:40:44.310704 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 12:40:44.310704 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 12:40:44.310704 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 12:40:44.310704 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 could not be found. Jun 29 12:40:44.310704 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:44.310704 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:44.310704 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:44.310704 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:44.310704 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:40:44.310704 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:40:44.310704 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:40:44.310704 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:40:44.310704 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 12:40:44.310704 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 12:40:44.310704 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:40:44.310704 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:40:44.310704 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 29 12:40:44.310704 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:40:44.312626 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 could not be found. Jun 29 12:40:44.312626 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:44.312626 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:40:44.312626 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:44.312626 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:40:44.312626 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:40:44.312626 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:40:44.312626 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:40:44.312626 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:40:44.312626 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 could not be found. Jun 29 12:40:44.312626 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:40:44.312626 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d72c0491-1a45-47dd-895e-f1229b495054 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] Returning 404 to user: Volume e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:40:44.312626 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d72c0491-1a45-47dd-895e-f1229b495054 tempest-VolumesSnapshotsTestJSON-533208371 tempest-VolumesSnapshotsTestJSON-533208371-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/e9dc844d-a663-4ff2-a318-0d9d0ed07fb1" status: 404 len: 109 microversion: 2.1 time: 0.034208 Jun 29 12:40:44.312626 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 389/801] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 12:40:44 2022] GET /compute/v2.1/os-volumes/e9dc844d-a663-4ff2-a318-0d9d0ed07fb1 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:40:45.085640 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-1bd79e80-0a44-47aa-b817-46ce17b40984 req-95d6bd2b-8a51-4b10-8fbc-f47acc04d528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0e0d99d-35d9-455b-944d-3468780b7ec0", "name": "network-vif-plugged", "status": "completed", "tag": "ba2f4f8f-721b-4ca9-baa6-9503942c77a9"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:40:45.095784 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-1bd79e80-0a44-47aa-b817-46ce17b40984 req-95d6bd2b-8a51-4b10-8fbc-f47acc04d528 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:45.096451 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-1bd79e80-0a44-47aa-b817-46ce17b40984 req-95d6bd2b-8a51-4b10-8fbc-f47acc04d528 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:45.106892 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-1bd79e80-0a44-47aa-b817-46ce17b40984 req-95d6bd2b-8a51-4b10-8fbc-f47acc04d528 service nova] Creating event network-vif-plugged:ba2f4f8f-721b-4ca9-baa6-9503942c77a9 for instance d0e0d99d-35d9-455b-944d-3468780b7ec0 on hv-cinder-81268 Jun 29 12:40:45.111952 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-1bd79e80-0a44-47aa-b817-46ce17b40984 req-95d6bd2b-8a51-4b10-8fbc-f47acc04d528 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030267 Jun 29 12:40:45.112495 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 413/802] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:40:45.271504 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b36e0881-3641-44e7-a028-dcf6961714b8 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:45.273326 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b36e0881-3641-44e7-a028-dcf6961714b8 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d0e0d99d-35d9-455b-944d-3468780b7ec0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:45.287699 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b36e0881-3641-44e7-a028-dcf6961714b8 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:45.288940 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b36e0881-3641-44e7-a028-dcf6961714b8 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:45.289892 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b36e0881-3641-44e7-a028-dcf6961714b8 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:45.291058 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b36e0881-3641-44e7-a028-dcf6961714b8 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:45.486962 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b36e0881-3641-44e7-a028-dcf6961714b8 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:45.495697 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b36e0881-3641-44e7-a028-dcf6961714b8 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0" status: 200 len: 1366 microversion: 2.1 time: 0.228284 Jun 29 12:40:45.502867 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 390/803] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:40:45 2022] GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:40:46.513703 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:40:46.516913 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=6 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:40:46.527820 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3114ffc3-4e1c-4048-88b1-c91154dcd795 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:46.528517 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3114ffc3-4e1c-4048-88b1-c91154dcd795 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d0e0d99d-35d9-455b-944d-3468780b7ec0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:46.535725 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3114ffc3-4e1c-4048-88b1-c91154dcd795 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:46.536234 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3114ffc3-4e1c-4048-88b1-c91154dcd795 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:46.536942 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3114ffc3-4e1c-4048-88b1-c91154dcd795 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:46.537335 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3114ffc3-4e1c-4048-88b1-c91154dcd795 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:46.684056 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3114ffc3-4e1c-4048-88b1-c91154dcd795 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:40:46.692118 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3114ffc3-4e1c-4048-88b1-c91154dcd795 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0" status: 200 len: 1555 microversion: 2.1 time: 0.180415 Jun 29 12:40:46.692679 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 414/804] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:40:46 2022] GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0 => generated 1555 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:40:46.708348 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8916bde7-97d3-4336-8a2f-23603c84764a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:40:46.708870 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8916bde7-97d3-4336-8a2f-23603c84764a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d0e0d99d-35d9-455b-944d-3468780b7ec0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:40:46.710788 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=6 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:40:46.716920 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8916bde7-97d3-4336-8a2f-23603c84764a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:46.717374 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8916bde7-97d3-4336-8a2f-23603c84764a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:46.718138 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8916bde7-97d3-4336-8a2f-23603c84764a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:46.718616 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8916bde7-97d3-4336-8a2f-23603c84764a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:46.793836 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8916bde7-97d3-4336-8a2f-23603c84764a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089254 Jun 29 12:40:46.794450 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 391/805] 10.222.0.52 () {58 vars in 1274 bytes} [Wed Jun 29 12:40:46 2022] GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:40:47.974496 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-e6c8e549-fac5-478e-a3f4-822ee4392218 req-04e80d78-c785-4078-992c-83e634baf4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0e0d99d-35d9-455b-944d-3468780b7ec0", "tag": "ba2f4f8f-721b-4ca9-baa6-9503942c77a9"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:40:47.983071 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-e6c8e549-fac5-478e-a3f4-822ee4392218 req-04e80d78-c785-4078-992c-83e634baf4d5 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:40:47.984132 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-e6c8e549-fac5-478e-a3f4-822ee4392218 req-04e80d78-c785-4078-992c-83e634baf4d5 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:40:47.994949 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-e6c8e549-fac5-478e-a3f4-822ee4392218 req-04e80d78-c785-4078-992c-83e634baf4d5 service nova] Creating event network-changed:ba2f4f8f-721b-4ca9-baa6-9503942c77a9 for instance d0e0d99d-35d9-455b-944d-3468780b7ec0 on hv-cinder-81268 Jun 29 12:40:48.000472 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-e6c8e549-fac5-478e-a3f4-822ee4392218 req-04e80d78-c785-4078-992c-83e634baf4d5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029336 Jun 29 12:40:48.001067 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 415/806] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:41:22.805526 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=7 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:41:22.806341 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=38 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:41:22.810659 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ed27d9f6-af50-4374-97a5-16b80d1d363a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:41:22.811148 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ed27d9f6-af50-4374-97a5-16b80d1d363a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d0e0d99d-35d9-455b-944d-3468780b7ec0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:41:22.818370 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ed27d9f6-af50-4374-97a5-16b80d1d363a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:22.818838 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ed27d9f6-af50-4374-97a5-16b80d1d363a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:22.819593 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ed27d9f6-af50-4374-97a5-16b80d1d363a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:22.820024 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ed27d9f6-af50-4374-97a5-16b80d1d363a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:22.843629 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ed27d9f6-af50-4374-97a5-16b80d1d363a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0/ips" status: 200 len: 149 microversion: 2.1 time: 0.039525 Jun 29 12:41:22.844182 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 392/807] 10.222.0.52 () {58 vars in 1247 bytes} [Wed Jun 29 12:41:22 2022] GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:41:24.159603 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=7 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:41:24.160521 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=28 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:41:24.165086 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3633030d-bd78-4721-b142-0c1951d4dfe3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48b5ebfb-7294-439f-9f9a-9a25d4dd6381"}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:41:24.166232 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3633030d-bd78-4721-b142-0c1951d4dfe3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d0e0d99d-35d9-455b-944d-3468780b7ec0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:41:24.174930 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3633030d-bd78-4721-b142-0c1951d4dfe3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:24.175387 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3633030d-bd78-4721-b142-0c1951d4dfe3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:24.176162 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3633030d-bd78-4721-b142-0c1951d4dfe3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:24.176598 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3633030d-bd78-4721-b142-0c1951d4dfe3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:24.424511 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3633030d-bd78-4721-b142-0c1951d4dfe3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "POST /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266545 Jun 29 12:41:24.425236 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 416/808] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Jun 29 12:41:24 2022] POST /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:41:30.881411 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b7b79f02-733f-44cd-bf24-a52ddc1f23b4 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48b5ebfb-7294-439f-9f9a-9a25d4dd6381"}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:41:30.882715 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b7b79f02-733f-44cd-bf24-a52ddc1f23b4 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d0e0d99d-35d9-455b-944d-3468780b7ec0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:41:30.890321 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b7b79f02-733f-44cd-bf24-a52ddc1f23b4 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:30.891610 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b7b79f02-733f-44cd-bf24-a52ddc1f23b4 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:30.892652 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b7b79f02-733f-44cd-bf24-a52ddc1f23b4 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:30.893165 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b7b79f02-733f-44cd-bf24-a52ddc1f23b4 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:30.980640 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-b7b79f02-733f-44cd-bf24-a52ddc1f23b4 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] HTTP exception thrown: Invalid volume: volume 48b5ebfb-7294-439f-9f9a-9a25d4dd6381 is already attached to instances: d0e0d99d-35d9-455b-944d-3468780b7ec0 Jun 29 12:41:30.982291 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b7b79f02-733f-44cd-bf24-a52ddc1f23b4 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Request method failure captured: Jun 29 12:41:30.982291 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: request: POST /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0/os-volume_attachments HTTP/1.1 Jun 29 12:41:30.982291 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept: application/json Jun 29 12:41:30.982291 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jun 29 12:41:30.982291 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Connection: close Jun 29 12:41:30.982291 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Length: 74 Jun 29 12:41:30.982291 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jun 29 12:41:30.982291 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Host: 10.222.0.52 Jun 29 12:41:30.982291 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jun 29 12:41:30.982291 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jun 29 12:41:30.982291 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivEe69aM7amLLdDw45pZkO9qxIeRFDOBVDEG3SD63-th4vjx46p2B2ho9vub7AbBeiopTeWWiq0plzI-faJHgEw8JRp3OpSKxo8ZAn9rjDDJbshayaHyBTJQDtsbH4um2iDB62naNRbVeYQvavven9SyQAHp1o14QRaoNvsRRGeWVuWU Jun 29 12:41:30.982291 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jun 29 12:41:30.982291 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jun 29 12:41:30.982291 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jun 29 12:41:30.982291 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jun 29 12:41:30.982291 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jun 29 12:41:30.982291 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jun 29 12:41:30.982291 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:41:30.982291 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:41:30.982291 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jun 29 12:41:30.982291 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jun 29 12:41:30.983796 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f18ffa75c23e4276a8b5b4fc3821fb87", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:41:30.983796 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:41:30.983796 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:41:30.983796 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:41:30.983796 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:41:30.983796 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jun 29 12:41:30.983796 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jun 29 12:41:30.983796 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Id: 2af4d4a69e9d4755bff61401f4349c78 Jun 29 12:41:30.983796 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:41:30.983796 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Jun 29 12:41:30.983796 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: {"volumeAttachment": {"volumeId": "48b5ebfb-7294-439f-9f9a-9a25d4dd6381"}} Jun 29 12:41:30.983796 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: method: > Jun 29 12:41:30.984905 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: exception: Invalid volume: volume 48b5ebfb-7294-439f-9f9a-9a25d4dd6381 is already attached to instances: d0e0d99d-35d9-455b-944d-3468780b7ec0 Jun 29 12:41:30.984905 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: action_args: {'server_id': 'd0e0d99d-35d9-455b-944d-3468780b7ec0', 'body': {'volumeAttachment': {'volumeId': '48b5ebfb-7294-439f-9f9a-9a25d4dd6381'}}} Jun 29 12:41:30.984905 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:41:30.984905 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:41:30.984905 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 29 12:41:30.984905 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 29 12:41:30.984905 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 12:41:30.984905 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 12:41:30.984905 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 12:41:30.984905 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 12:41:30.984905 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 29 12:41:30.984905 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 29 12:41:30.984905 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 29 12:41:30.984905 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 29 12:41:30.984905 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 48b5ebfb-7294-439f-9f9a-9a25d4dd6381 is already attached to instances: d0e0d99d-35d9-455b-944d-3468780b7ec0 Jun 29 12:41:30.984905 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:41:30.984905 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:41:30.984905 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:41:30.984905 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:41:30.986701 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:41:30.986701 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:41:30.986701 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:41:30.986701 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:41:30.986701 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:41:30.986701 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:41:30.986701 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 12:41:30.986701 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 12:41:30.986701 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 12:41:30.986701 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 12:41:30.986701 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 12:41:30.986701 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 12:41:30.986701 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 29 12:41:30.986701 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 12:41:30.986701 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 48b5ebfb-7294-439f-9f9a-9a25d4dd6381 is already attached to instances: d0e0d99d-35d9-455b-944d-3468780b7ec0 Jun 29 12:41:30.986701 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:41:30.986701 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:41:30.986701 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:41:30.986701 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:41:30.986701 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:41:30.988383 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:41:30.988383 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:41:30.988383 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:41:30.988383 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 48b5ebfb-7294-439f-9f9a-9a25d4dd6381 is already attached to instances: d0e0d99d-35d9-455b-944d-3468780b7ec0 Jun 29 12:41:30.988383 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:41:30.988383 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b7b79f02-733f-44cd-bf24-a52ddc1f23b4 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Returning 400 to user: Invalid volume: volume 48b5ebfb-7294-439f-9f9a-9a25d4dd6381 is already attached to instances: d0e0d99d-35d9-455b-944d-3468780b7ec0 {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:41:30.988383 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b7b79f02-733f-44cd-bf24-a52ddc1f23b4 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "POST /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109027 Jun 29 12:41:30.988383 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 393/809] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Jun 29 12:41:30 2022] POST /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 12:41:31.047090 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4cfac3e4-5243-42ce-83d0-c7db830ccf64 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:41:31.047767 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4cfac3e4-5243-42ce-83d0-c7db830ccf64 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d0e0d99d-35d9-455b-944d-3468780b7ec0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:41:31.053901 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4cfac3e4-5243-42ce-83d0-c7db830ccf64 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:31.054342 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4cfac3e4-5243-42ce-83d0-c7db830ccf64 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:31.055119 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4cfac3e4-5243-42ce-83d0-c7db830ccf64 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:31.055546 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4cfac3e4-5243-42ce-83d0-c7db830ccf64 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:31.138694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-4cfac3e4-5243-42ce-83d0-c7db830ccf64 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lazy-loading 'services' on Instance uuid d0e0d99d-35d9-455b-944d-3468780b7ec0 {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 12:41:31.217722 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4cfac3e4-5243-42ce-83d0-c7db830ccf64 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0/os-volume_attachments/48b5ebfb-7294-439f-9f9a-9a25d4dd6381" status: 202 len: 0 microversion: 2.1 time: 0.175202 Jun 29 12:41:31.218318 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 417/810] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 12:41:31 2022] DELETE /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0/os-volume_attachments/48b5ebfb-7294-439f-9f9a-9a25d4dd6381 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:41:31.226958 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5bdc10d3-9e3f-45aa-a0d2-83c3757c7d08 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:41:31.228016 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5bdc10d3-9e3f-45aa-a0d2-83c3757c7d08 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d0e0d99d-35d9-455b-944d-3468780b7ec0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:41:31.235299 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5bdc10d3-9e3f-45aa-a0d2-83c3757c7d08 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:31.235942 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5bdc10d3-9e3f-45aa-a0d2-83c3757c7d08 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:31.236750 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5bdc10d3-9e3f-45aa-a0d2-83c3757c7d08 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:31.237367 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5bdc10d3-9e3f-45aa-a0d2-83c3757c7d08 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:31.271271 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5bdc10d3-9e3f-45aa-a0d2-83c3757c7d08 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048098 Jun 29 12:41:31.272036 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 394/811] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 12:41:31 2022] GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:41:32.290542 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-21d33002-576b-45a2-801b-1e2cdc7a94de tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:41:32.291604 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-21d33002-576b-45a2-801b-1e2cdc7a94de tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d0e0d99d-35d9-455b-944d-3468780b7ec0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:41:32.297785 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-21d33002-576b-45a2-801b-1e2cdc7a94de tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:32.298231 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-21d33002-576b-45a2-801b-1e2cdc7a94de tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:32.299021 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-21d33002-576b-45a2-801b-1e2cdc7a94de tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:32.299458 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-21d33002-576b-45a2-801b-1e2cdc7a94de tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:32.327513 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-21d33002-576b-45a2-801b-1e2cdc7a94de tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041912 Jun 29 12:41:32.328117 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 418/812] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 12:41:32 2022] GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 12:41:32.387235 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-46ee2945-d3a9-4659-b8f6-b7bd65968fd2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:41:32.387741 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-46ee2945-d3a9-4659-b8f6-b7bd65968fd2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d0e0d99d-35d9-455b-944d-3468780b7ec0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:41:32.395369 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-46ee2945-d3a9-4659-b8f6-b7bd65968fd2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:32.396073 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-46ee2945-d3a9-4659-b8f6-b7bd65968fd2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:32.396836 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-46ee2945-d3a9-4659-b8f6-b7bd65968fd2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:32.397271 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-46ee2945-d3a9-4659-b8f6-b7bd65968fd2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:32.423456 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-46ee2945-d3a9-4659-b8f6-b7bd65968fd2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d0e0d99d-35d9-455b-944d-3468780b7ec0] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 12:41:32.502299 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-46ee2945-d3a9-4659-b8f6-b7bd65968fd2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0" status: 204 len: 0 microversion: 2.1 time: 0.118583 Jun 29 12:41:32.503164 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 395/813] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:41:32 2022] DELETE /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 12:41:32.511053 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d1dc0238-2f1a-45a5-8972-0af6c331dc77 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:41:32.511653 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d1dc0238-2f1a-45a5-8972-0af6c331dc77 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d0e0d99d-35d9-455b-944d-3468780b7ec0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:41:32.518522 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d1dc0238-2f1a-45a5-8972-0af6c331dc77 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:32.518970 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d1dc0238-2f1a-45a5-8972-0af6c331dc77 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:32.519726 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d1dc0238-2f1a-45a5-8972-0af6c331dc77 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:32.520155 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d1dc0238-2f1a-45a5-8972-0af6c331dc77 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:32.658584 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d1dc0238-2f1a-45a5-8972-0af6c331dc77 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:41:32.666052 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d1dc0238-2f1a-45a5-8972-0af6c331dc77 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0" status: 200 len: 1680 microversion: 2.1 time: 0.158746 Jun 29 12:41:32.666643 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 419/814] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:41:32 2022] GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:41:33.684086 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0817b0ab-79fc-4f49-ae96-2f1f6babb6e5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:41:33.684702 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0817b0ab-79fc-4f49-ae96-2f1f6babb6e5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d0e0d99d-35d9-455b-944d-3468780b7ec0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:41:33.691888 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0817b0ab-79fc-4f49-ae96-2f1f6babb6e5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:33.692341 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0817b0ab-79fc-4f49-ae96-2f1f6babb6e5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:33.693100 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0817b0ab-79fc-4f49-ae96-2f1f6babb6e5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:33.693538 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0817b0ab-79fc-4f49-ae96-2f1f6babb6e5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:33.826131 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0817b0ab-79fc-4f49-ae96-2f1f6babb6e5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:41:33.833989 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0817b0ab-79fc-4f49-ae96-2f1f6babb6e5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0" status: 200 len: 1680 microversion: 2.1 time: 0.154247 Jun 29 12:41:33.834583 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 396/815] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:41:33 2022] GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:41:34.823954 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-06c87f01-397a-40b1-a5b9-dff5aaa47305 req-47c2d2f3-05bb-4c20-8c1f-a45cb197fb8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0e0d99d-35d9-455b-944d-3468780b7ec0", "name": "network-vif-deleted", "tag": "ba2f4f8f-721b-4ca9-baa6-9503942c77a9"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:41:34.839691 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-06c87f01-397a-40b1-a5b9-dff5aaa47305 req-47c2d2f3-05bb-4c20-8c1f-a45cb197fb8c service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:34.840577 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-06c87f01-397a-40b1-a5b9-dff5aaa47305 req-47c2d2f3-05bb-4c20-8c1f-a45cb197fb8c service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:34.857606 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3bbd3084-8aba-472a-a35d-dafdd547b45c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:41:34.861314 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3bbd3084-8aba-472a-a35d-dafdd547b45c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d0e0d99d-35d9-455b-944d-3468780b7ec0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:41:34.876714 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3bbd3084-8aba-472a-a35d-dafdd547b45c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:34.877124 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-06c87f01-397a-40b1-a5b9-dff5aaa47305 req-47c2d2f3-05bb-4c20-8c1f-a45cb197fb8c service nova] Creating event network-vif-deleted:ba2f4f8f-721b-4ca9-baa6-9503942c77a9 for instance d0e0d99d-35d9-455b-944d-3468780b7ec0 on hv-cinder-81268 Jun 29 12:41:34.878162 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3bbd3084-8aba-472a-a35d-dafdd547b45c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:34.879782 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3bbd3084-8aba-472a-a35d-dafdd547b45c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:34.880957 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3bbd3084-8aba-472a-a35d-dafdd547b45c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:34.886941 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-06c87f01-397a-40b1-a5b9-dff5aaa47305 req-47c2d2f3-05bb-4c20-8c1f-a45cb197fb8c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068400 Jun 29 12:41:34.887542 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 420/816] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:41:34.973414 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-3bbd3084-8aba-472a-a35d-dafdd547b45c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:41:34.982746 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3bbd3084-8aba-472a-a35d-dafdd547b45c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0" status: 200 len: 1325 microversion: 2.1 time: 0.134059 Jun 29 12:41:34.994681 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 397/817] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:41:34 2022] GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0 => generated 1325 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:41:36.005321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-eee68856-b0dc-445c-932a-9ef14655f408 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:41:36.006017 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-eee68856-b0dc-445c-932a-9ef14655f408 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d0e0d99d-35d9-455b-944d-3468780b7ec0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:41:36.012959 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-eee68856-b0dc-445c-932a-9ef14655f408 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:36.013397 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-eee68856-b0dc-445c-932a-9ef14655f408 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:36.014163 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-eee68856-b0dc-445c-932a-9ef14655f408 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:36.014642 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-eee68856-b0dc-445c-932a-9ef14655f408 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:36.029252 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-eee68856-b0dc-445c-932a-9ef14655f408 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] HTTP exception thrown: Instance d0e0d99d-35d9-455b-944d-3468780b7ec0 could not be found. Jun 29 12:41:36.030991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-eee68856-b0dc-445c-932a-9ef14655f408 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Request method failure captured: Jun 29 12:41:36.030991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0 HTTP/1.1 Jun 29 12:41:36.030991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:41:36.030991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:41:36.030991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:41:36.030991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:41:36.030991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:41:36.030991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:41:36.030991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:41:36.030991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:41:36.030991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEe69aM7amLLdDw45pZkO9qxIeRFDOBVDEG3SD63-th4vjx46p2B2ho9vub7AbBeiopTeWWiq0plzI-faJHgEw8JRp3OpSKxo8ZAn9rjDDJbshayaHyBTJQDtsbH4um2iDB62naNRbVeYQvavven9SyQAHp1o14QRaoNvsRRGeWVuWU Jun 29 12:41:36.030991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:41:36.030991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:41:36.030991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:41:36.030991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:41:36.030991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:41:36.030991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:41:36.030991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:41:36.030991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:41:36.030991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:41:36.030991 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:41:36.033077 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f18ffa75c23e4276a8b5b4fc3821fb87", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:41:36.033077 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:41:36.033077 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:41:36.033077 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:41:36.033077 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:41:36.033077 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:41:36.033077 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:41:36.033077 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: 2af4d4a69e9d4755bff61401f4349c78 Jun 29 12:41:36.033077 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:41:36.033077 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:41:36.033077 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Instance d0e0d99d-35d9-455b-944d-3468780b7ec0 could not be found. Jun 29 12:41:36.033077 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': 'd0e0d99d-35d9-455b-944d-3468780b7ec0'} Jun 29 12:41:36.037499 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:41:36.037499 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:41:36.037499 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:41:36.037499 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:41:36.037499 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:41:36.037499 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:41:36.037499 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:41:36.037499 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:41:36.037499 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:41:36.037499 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:41:36.037499 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0e0d99d-35d9-455b-944d-3468780b7ec0 could not be found. Jun 29 12:41:36.037499 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:41:36.037499 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:41:36.037499 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:41:36.037499 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:41:36.037499 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:41:36.037499 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:41:36.037499 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:41:36.037499 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:41:36.037499 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:41:36.038958 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:41:36.038958 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:41:36.038958 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:41:36.038958 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:41:36.038958 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:41:36.038958 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:41:36.038958 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:41:36.038958 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0e0d99d-35d9-455b-944d-3468780b7ec0 could not be found. Jun 29 12:41:36.038958 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:41:36.038958 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:41:36.038958 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:41:36.038958 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:41:36.038958 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:41:36.038958 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:41:36.038958 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:41:36.038958 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:41:36.038958 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0e0d99d-35d9-455b-944d-3468780b7ec0 could not be found. Jun 29 12:41:36.038958 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:41:36.040125 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-eee68856-b0dc-445c-932a-9ef14655f408 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Returning 404 to user: Instance d0e0d99d-35d9-455b-944d-3468780b7ec0 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:41:36.040125 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-eee68856-b0dc-445c-932a-9ef14655f408 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0" status: 404 len: 111 microversion: 2.1 time: 0.032739 Jun 29 12:41:36.040125 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 421/818] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:41:35 2022] GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:41:36.041707 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9f02ca63-1a93-4782-80eb-5d1db681b277 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '.version_select at 0x7fdb0680d040>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:41:36.059200 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9f02ca63-1a93-4782-80eb-5d1db681b277 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-583119635" status: 202 len: 0 microversion: 2.1 time: 0.021254 Jun 29 12:41:36.059744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 398/819] 10.222.0.52 () {58 vars in 1217 bytes} [Wed Jun 29 12:41:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-583119635 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:41:36.688560 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d36052d2-da7e-483f-b36b-2defc3e48120 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Action: 'create', calling method: .version_select at 0x7fdb068b3ca0>, body: {"keypair": {"name": "tempest-keypair-428437870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPW9gHgW48DpJtflxj0kQchZxdKzhRfmr3ZPnuvQ+rPD5Tk7JoR2AB/SZg1DQF2mdVZ5r1vqIB+sq2e6dLQv0piCKqVnkf6KfIv4Bwpe2hgFRVXURSp5hGfubP4PU8/tlA=="}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:41:36.701982 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-d36052d2-da7e-483f-b36b-2defc3e48120 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Getting quotas for project f18ffa75c23e4276a8b5b4fc3821fb87. Resources: {'key_pairs'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:41:36.706452 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-d36052d2-da7e-483f-b36b-2defc3e48120 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Getting quotas for user 2af4d4a69e9d4755bff61401f4349c78 and project f18ffa75c23e4276a8b5b4fc3821fb87. Resources: {'key_pairs'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:41:36.728112 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d36052d2-da7e-483f-b36b-2defc3e48120 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044050 Jun 29 12:41:36.728909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 422/820] 10.222.0.52 () {60 vars in 1158 bytes} [Wed Jun 29 12:41:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:41:38.004746 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3f8c8a5a-e22f-4fb6-a31f-a455938a4ae2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-629850966", "imageRef": "70887696-f652-46b0-a5be-bfb400986078", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a4c9384-2272-4ef8-9e7c-74de83b9d3b0"}], "security_groups": [{"name": "tempest-securitygroup--1145095968"}], "key_name": "tempest-keypair-428437870", "user_data": "}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:41:38.106860 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.network.neutron [None req-3f8c8a5a-e22f-4fb6-a31f-a455938a4ae2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] validate_networks() for [('9a4c9384-2272-4ef8-9e7c-74de83b9d3b0', None, None, None, None, None)] {{(pid=124316) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 12:41:38.561670 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-3f8c8a5a-e22f-4fb6-a31f-a455938a4ae2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Flavor limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 12:41:38.562128 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-3f8c8a5a-e22f-4fb6-a31f-a455938a4ae2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Image limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 12:41:38.563315 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-3f8c8a5a-e22f-4fb6-a31f-a455938a4ae2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Flavor pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 12:41:38.563732 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-3f8c8a5a-e22f-4fb6-a31f-a455938a4ae2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Image pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 12:41:38.564155 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-3f8c8a5a-e22f-4fb6-a31f-a455938a4ae2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 12:41:38.572854 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3f8c8a5a-e22f-4fb6-a31f-a455938a4ae2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:38.573494 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3f8c8a5a-e22f-4fb6-a31f-a455938a4ae2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:38.574293 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3f8c8a5a-e22f-4fb6-a31f-a455938a4ae2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:38.574765 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3f8c8a5a-e22f-4fb6-a31f-a455938a4ae2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:38.590991 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-3f8c8a5a-e22f-4fb6-a31f-a455938a4ae2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Getting quotas for project f18ffa75c23e4276a8b5b4fc3821fb87. Resources: {'cores', 'ram', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:41:38.595346 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-3f8c8a5a-e22f-4fb6-a31f-a455938a4ae2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Getting quotas for user 2af4d4a69e9d4755bff61401f4349c78 and project f18ffa75c23e4276a8b5b4fc3821fb87. Resources: {'cores', 'ram', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:41:38.605997 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3f8c8a5a-e22f-4fb6-a31f-a455938a4ae2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Going to run 1 instances... {{(pid=124316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 12:41:38.608244 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3f8c8a5a-e22f-4fb6-a31f-a455938a4ae2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70887696-f652-46b0-a5be-bfb400986078',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 12:41:38.654388 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3f8c8a5a-e22f-4fb6-a31f-a455938a4ae2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.653946 Jun 29 12:41:38.655255 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 399/821] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 12:41:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 12:41:38.665748 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-35fd1237-7deb-4f34-abbe-3af30f4bed57 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:41:38.666482 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-35fd1237-7deb-4f34-abbe-3af30f4bed57 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:41:38.724816 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-35fd1237-7deb-4f34-abbe-3af30f4bed57 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:41:38.731448 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-35fd1237-7deb-4f34-abbe-3af30f4bed57 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741" status: 200 len: 1240 microversion: 2.1 time: 0.070061 Jun 29 12:41:38.732032 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 423/822] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:41:38 2022] GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741 => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:41:39.749400 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8ccc88ff-38e9-4dce-94b1-2b5cb990b779 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:41:39.750557 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8ccc88ff-38e9-4dce-94b1-2b5cb990b779 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:41:39.803724 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8ccc88ff-38e9-4dce-94b1-2b5cb990b779 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:41:39.810470 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8ccc88ff-38e9-4dce-94b1-2b5cb990b779 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741" status: 200 len: 1240 microversion: 2.1 time: 0.065325 Jun 29 12:41:39.811035 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 400/823] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:41:39 2022] GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741 => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:41:40.827989 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c710ebc3-1801-4407-a091-8cb4d5ca77aa tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:41:40.829281 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c710ebc3-1801-4407-a091-8cb4d5ca77aa tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:41:40.882984 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c710ebc3-1801-4407-a091-8cb4d5ca77aa tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:41:40.889514 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c710ebc3-1801-4407-a091-8cb4d5ca77aa tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741" status: 200 len: 1240 microversion: 2.1 time: 0.065414 Jun 29 12:41:40.890067 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 424/824] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:41:40 2022] GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741 => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:41:41.906937 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0497ced5-1403-4aaa-b3e9-2677f25067df tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:41:41.907568 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0497ced5-1403-4aaa-b3e9-2677f25067df tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:41:41.961649 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0497ced5-1403-4aaa-b3e9-2677f25067df tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:41:41.968349 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0497ced5-1403-4aaa-b3e9-2677f25067df tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741" status: 200 len: 1240 microversion: 2.1 time: 0.065199 Jun 29 12:41:41.968909 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 401/825] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:41:41 2022] GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741 => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:41:42.986828 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-93f54a94-5158-4718-b402-98c0a719203c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:41:42.987447 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-93f54a94-5158-4718-b402-98c0a719203c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:41:42.994378 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-93f54a94-5158-4718-b402-98c0a719203c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:42.994865 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-93f54a94-5158-4718-b402-98c0a719203c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:42.995625 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-93f54a94-5158-4718-b402-98c0a719203c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:42.996059 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-93f54a94-5158-4718-b402-98c0a719203c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:43.056934 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-93f54a94-5158-4718-b402-98c0a719203c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:41:43.064427 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-93f54a94-5158-4718-b402-98c0a719203c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741" status: 200 len: 1244 microversion: 2.1 time: 0.082084 Jun 29 12:41:43.065070 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 425/826] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:41:42 2022] GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:41:44.082264 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4198ff17-eb31-4f4f-bcad-6026a78ce0dd tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:41:44.082907 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4198ff17-eb31-4f4f-bcad-6026a78ce0dd tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:41:44.090221 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4198ff17-eb31-4f4f-bcad-6026a78ce0dd tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:44.090776 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4198ff17-eb31-4f4f-bcad-6026a78ce0dd tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:44.091548 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4198ff17-eb31-4f4f-bcad-6026a78ce0dd tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:44.091986 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4198ff17-eb31-4f4f-bcad-6026a78ce0dd tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:44.162902 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4198ff17-eb31-4f4f-bcad-6026a78ce0dd tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:41:44.170213 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4198ff17-eb31-4f4f-bcad-6026a78ce0dd tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741" status: 200 len: 1298 microversion: 2.1 time: 0.092946 Jun 29 12:41:44.170802 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 402/827] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:41:44 2022] GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741 => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:41:45.188272 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-7f1ca984-f3d6-4db9-b38b-ea06c1c0d4a2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:41:45.190311 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-7f1ca984-f3d6-4db9-b38b-ea06c1c0d4a2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:41:45.197702 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7f1ca984-f3d6-4db9-b38b-ea06c1c0d4a2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:45.198684 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7f1ca984-f3d6-4db9-b38b-ea06c1c0d4a2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:45.199575 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7f1ca984-f3d6-4db9-b38b-ea06c1c0d4a2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:45.200182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7f1ca984-f3d6-4db9-b38b-ea06c1c0d4a2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:45.289622 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-85dd8bb7-01f3-4f33-8eb8-e50805a84d23 req-10a0f95d-07b3-40d7-9ffa-e78d49a5186d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "753cf309-773f-450e-a78f-c705c283a741", "tag": "e68bb634-c4ca-4066-b821-2b34535537f8"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:41:45.298311 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-85dd8bb7-01f3-4f33-8eb8-e50805a84d23 req-10a0f95d-07b3-40d7-9ffa-e78d49a5186d service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:45.298865 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-85dd8bb7-01f3-4f33-8eb8-e50805a84d23 req-10a0f95d-07b3-40d7-9ffa-e78d49a5186d service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:45.310950 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-85dd8bb7-01f3-4f33-8eb8-e50805a84d23 req-10a0f95d-07b3-40d7-9ffa-e78d49a5186d service nova] Creating event network-changed:e68bb634-c4ca-4066-b821-2b34535537f8 for instance 753cf309-773f-450e-a78f-c705c283a741 on hv-cinder-81268 Jun 29 12:41:45.317297 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-85dd8bb7-01f3-4f33-8eb8-e50805a84d23 req-10a0f95d-07b3-40d7-9ffa-e78d49a5186d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031265 Jun 29 12:41:45.318244 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 403/828] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:41:45.359423 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-7f1ca984-f3d6-4db9-b38b-ea06c1c0d4a2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:41:45.367790 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-7f1ca984-f3d6-4db9-b38b-ea06c1c0d4a2 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741" status: 200 len: 1366 microversion: 2.1 time: 0.184161 Jun 29 12:41:45.368488 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 426/829] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:41:45 2022] GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:41:46.386246 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4a4c2c6b-ee2b-4d84-ab9b-38edc3278d9b tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:41:46.387000 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4a4c2c6b-ee2b-4d84-ab9b-38edc3278d9b tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:41:46.393768 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4a4c2c6b-ee2b-4d84-ab9b-38edc3278d9b tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:46.394224 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4a4c2c6b-ee2b-4d84-ab9b-38edc3278d9b tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:46.395020 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4a4c2c6b-ee2b-4d84-ab9b-38edc3278d9b tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:46.395712 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4a4c2c6b-ee2b-4d84-ab9b-38edc3278d9b tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:46.534791 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4a4c2c6b-ee2b-4d84-ab9b-38edc3278d9b tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:41:46.542344 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4a4c2c6b-ee2b-4d84-ab9b-38edc3278d9b tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741" status: 200 len: 1366 microversion: 2.1 time: 0.161005 Jun 29 12:41:46.542920 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 404/830] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:41:46 2022] GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:41:47.559737 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e81aed30-9564-4eb3-a934-6e04d9e20055 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:41:47.560324 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e81aed30-9564-4eb3-a934-6e04d9e20055 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:41:47.567471 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e81aed30-9564-4eb3-a934-6e04d9e20055 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:47.567915 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e81aed30-9564-4eb3-a934-6e04d9e20055 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:47.568655 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e81aed30-9564-4eb3-a934-6e04d9e20055 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:47.569081 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e81aed30-9564-4eb3-a934-6e04d9e20055 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:47.702169 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e81aed30-9564-4eb3-a934-6e04d9e20055 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:41:47.710612 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e81aed30-9564-4eb3-a934-6e04d9e20055 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741" status: 200 len: 1366 microversion: 2.1 time: 0.154564 Jun 29 12:41:47.711198 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 427/831] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:41:47 2022] GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:41:48.727020 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a972f58e-9582-467b-8046-13274a842dc3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:41:48.727569 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-a972f58e-9582-467b-8046-13274a842dc3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:41:48.730107 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:41:48.736889 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a972f58e-9582-467b-8046-13274a842dc3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:48.737412 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a972f58e-9582-467b-8046-13274a842dc3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:48.738276 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a972f58e-9582-467b-8046-13274a842dc3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:48.738800 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-a972f58e-9582-467b-8046-13274a842dc3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:48.871149 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-a972f58e-9582-467b-8046-13274a842dc3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:41:48.879819 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a972f58e-9582-467b-8046-13274a842dc3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741" status: 200 len: 1366 microversion: 2.1 time: 0.156693 Jun 29 12:41:48.880443 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 405/832] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:41:48 2022] GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:41:49.897839 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ebbcec99-5852-4b26-8b75-05c769133019 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:41:49.898483 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ebbcec99-5852-4b26-8b75-05c769133019 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:41:49.904834 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ebbcec99-5852-4b26-8b75-05c769133019 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:49.905273 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ebbcec99-5852-4b26-8b75-05c769133019 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:49.906014 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ebbcec99-5852-4b26-8b75-05c769133019 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:49.906460 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ebbcec99-5852-4b26-8b75-05c769133019 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:50.036664 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ebbcec99-5852-4b26-8b75-05c769133019 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:41:50.044518 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ebbcec99-5852-4b26-8b75-05c769133019 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741" status: 200 len: 1366 microversion: 2.1 time: 0.150729 Jun 29 12:41:50.045090 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 428/833] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:41:49 2022] GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:41:51.061375 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1935a6b6-cc5f-400a-830f-b34bcf647862 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:41:51.061957 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-1935a6b6-cc5f-400a-830f-b34bcf647862 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:41:51.068088 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1935a6b6-cc5f-400a-830f-b34bcf647862 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:51.068538 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1935a6b6-cc5f-400a-830f-b34bcf647862 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:51.069310 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1935a6b6-cc5f-400a-830f-b34bcf647862 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:51.069747 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1935a6b6-cc5f-400a-830f-b34bcf647862 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:51.204014 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-1935a6b6-cc5f-400a-830f-b34bcf647862 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:41:51.212578 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-1935a6b6-cc5f-400a-830f-b34bcf647862 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741" status: 200 len: 1366 microversion: 2.1 time: 0.155144 Jun 29 12:41:51.213699 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 406/834] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:41:51 2022] GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:41:51.474379 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-250e232f-4d00-44a2-bbc5-2e3bfe15e752 req-e9f1d887-8661-461e-85b7-7551d25ee650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "753cf309-773f-450e-a78f-c705c283a741", "name": "network-vif-plugged", "status": "completed", "tag": "e68bb634-c4ca-4066-b821-2b34535537f8"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:41:51.479674 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=8 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:41:51.484610 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-250e232f-4d00-44a2-bbc5-2e3bfe15e752 req-e9f1d887-8661-461e-85b7-7551d25ee650 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:51.485193 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-250e232f-4d00-44a2-bbc5-2e3bfe15e752 req-e9f1d887-8661-461e-85b7-7551d25ee650 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:51.497366 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-250e232f-4d00-44a2-bbc5-2e3bfe15e752 req-e9f1d887-8661-461e-85b7-7551d25ee650 service nova] Creating event network-vif-plugged:e68bb634-c4ca-4066-b821-2b34535537f8 for instance 753cf309-773f-450e-a78f-c705c283a741 on hv-cinder-81268 Jun 29 12:41:51.502283 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-250e232f-4d00-44a2-bbc5-2e3bfe15e752 req-e9f1d887-8661-461e-85b7-7551d25ee650 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032954 Jun 29 12:41:51.503027 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 429/835] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:41:52.232180 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-94549d54-3bff-4504-841d-7dfd39c525ee tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:41:52.232720 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-94549d54-3bff-4504-841d-7dfd39c525ee tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:41:52.234569 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=10 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:41:52.242533 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-94549d54-3bff-4504-841d-7dfd39c525ee tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:52.243093 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-94549d54-3bff-4504-841d-7dfd39c525ee tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:52.244177 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-94549d54-3bff-4504-841d-7dfd39c525ee tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:52.244612 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-94549d54-3bff-4504-841d-7dfd39c525ee tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:52.382381 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-94549d54-3bff-4504-841d-7dfd39c525ee tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:41:52.390008 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-94549d54-3bff-4504-841d-7dfd39c525ee tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741" status: 200 len: 1366 microversion: 2.1 time: 0.161853 Jun 29 12:41:52.390610 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 407/836] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:41:52 2022] GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:41:53.409583 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b5da9e5b-8910-404f-bd67-1ab859080674 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:41:53.410178 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b5da9e5b-8910-404f-bd67-1ab859080674 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:41:53.416335 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b5da9e5b-8910-404f-bd67-1ab859080674 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:53.416778 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b5da9e5b-8910-404f-bd67-1ab859080674 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:53.417522 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b5da9e5b-8910-404f-bd67-1ab859080674 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:53.417950 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b5da9e5b-8910-404f-bd67-1ab859080674 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:53.555012 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b5da9e5b-8910-404f-bd67-1ab859080674 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:41:53.562495 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b5da9e5b-8910-404f-bd67-1ab859080674 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741" status: 200 len: 1555 microversion: 2.1 time: 0.158109 Jun 29 12:41:53.563046 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 430/837] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:41:53 2022] GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:41:53.580054 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-19dc95db-4f18-47d2-bf2f-f371b469bd6d tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:41:53.580707 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-19dc95db-4f18-47d2-bf2f-f371b469bd6d tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:41:53.583232 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:41:53.589696 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-19dc95db-4f18-47d2-bf2f-f371b469bd6d tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:53.590143 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-19dc95db-4f18-47d2-bf2f-f371b469bd6d tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:53.590934 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-19dc95db-4f18-47d2-bf2f-f371b469bd6d tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:53.591366 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-19dc95db-4f18-47d2-bf2f-f371b469bd6d tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:53.594294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:41:53.674454 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-19dc95db-4f18-47d2-bf2f-f371b469bd6d tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098493 Jun 29 12:41:53.675054 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 408/838] 10.222.0.52 () {58 vars in 1274 bytes} [Wed Jun 29 12:41:53 2022] GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:41:54.621392 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-31e92633-47f2-491e-83fd-59de3fd25128 req-94434889-088f-4eda-b72e-9d515fbf986b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "753cf309-773f-450e-a78f-c705c283a741", "tag": "e68bb634-c4ca-4066-b821-2b34535537f8"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:41:54.626108 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:41:54.633483 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-31e92633-47f2-491e-83fd-59de3fd25128 req-94434889-088f-4eda-b72e-9d515fbf986b service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:41:54.633926 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-31e92633-47f2-491e-83fd-59de3fd25128 req-94434889-088f-4eda-b72e-9d515fbf986b service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:41:54.637899 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:41:54.645794 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-31e92633-47f2-491e-83fd-59de3fd25128 req-94434889-088f-4eda-b72e-9d515fbf986b service nova] Creating event network-changed:e68bb634-c4ca-4066-b821-2b34535537f8 for instance 753cf309-773f-450e-a78f-c705c283a741 on hv-cinder-81268 Jun 29 12:41:54.651369 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-31e92633-47f2-491e-83fd-59de3fd25128 req-94434889-088f-4eda-b72e-9d515fbf986b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034100 Jun 29 12:41:54.651996 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 431/839] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:42:08.425584 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:42:08.426847 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=3 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:42:08.430106 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-3bd7247a-e557-4c3e-9e80-9e2816bdcb81 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1998241196", "imageRef": "70887696-f652-46b0-a5be-bfb400986078", "flavorRef": "452", "networks": [{"uuid": "1fa0fcca-656c-4166-b81d-3710eb67922d"}]}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:42:08.481298 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.network.neutron [None req-3bd7247a-e557-4c3e-9e80-9e2816bdcb81 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] validate_networks() for [('1fa0fcca-656c-4166-b81d-3710eb67922d', None, None, None, None, None)] {{(pid=124316) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 12:42:08.825587 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-3bd7247a-e557-4c3e-9e80-9e2816bdcb81 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Flavor limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 12:42:08.826077 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-3bd7247a-e557-4c3e-9e80-9e2816bdcb81 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Image limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 12:42:08.826736 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-3bd7247a-e557-4c3e-9e80-9e2816bdcb81 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Flavor pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 12:42:08.827148 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-3bd7247a-e557-4c3e-9e80-9e2816bdcb81 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Image pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 12:42:08.827559 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-3bd7247a-e557-4c3e-9e80-9e2816bdcb81 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 12:42:08.836809 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3bd7247a-e557-4c3e-9e80-9e2816bdcb81 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:08.837252 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3bd7247a-e557-4c3e-9e80-9e2816bdcb81 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:08.838069 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3bd7247a-e557-4c3e-9e80-9e2816bdcb81 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:08.838537 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-3bd7247a-e557-4c3e-9e80-9e2816bdcb81 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:08.854726 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-3bd7247a-e557-4c3e-9e80-9e2816bdcb81 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Getting quotas for project e1ba9e59fe574391a0c8342daed01416. Resources: {'cores', 'ram', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:42:08.858409 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-3bd7247a-e557-4c3e-9e80-9e2816bdcb81 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Getting quotas for user eb9bae5e3522437182d2650c3fcfdef6 and project e1ba9e59fe574391a0c8342daed01416. Resources: {'cores', 'ram', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:42:08.869518 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3bd7247a-e557-4c3e-9e80-9e2816bdcb81 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Going to run 1 instances... {{(pid=124316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 12:42:08.871973 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-3bd7247a-e557-4c3e-9e80-9e2816bdcb81 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 4098d777-3800-4629-b323-cdc50b1e7ad0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70887696-f652-46b0-a5be-bfb400986078',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 12:42:08.915753 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-3bd7247a-e557-4c3e-9e80-9e2816bdcb81 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.491910 Jun 29 12:42:08.916384 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 409/840] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 12:42:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 29 12:42:08.924216 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:42:08.928846 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-23ed26de-4720-4ff1-a354-3c53d73632e3 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:08.929577 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-23ed26de-4720-4ff1-a354-3c53d73632e3 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 4098d777-3800-4629-b323-cdc50b1e7ad0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:08.990519 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-23ed26de-4720-4ff1-a354-3c53d73632e3 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:42:08.997226 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-23ed26de-4720-4ff1-a354-3c53d73632e3 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0" status: 200 len: 1219 microversion: 2.1 time: 0.074699 Jun 29 12:42:08.997782 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 432/841] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:42:08 2022] GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:42:10.015070 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f53c507f-8d99-460b-93c3-53434a0ebbf1 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:10.015850 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f53c507f-8d99-460b-93c3-53434a0ebbf1 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 4098d777-3800-4629-b323-cdc50b1e7ad0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:10.023207 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f53c507f-8d99-460b-93c3-53434a0ebbf1 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:10.023889 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f53c507f-8d99-460b-93c3-53434a0ebbf1 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:10.024707 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f53c507f-8d99-460b-93c3-53434a0ebbf1 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:10.025308 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f53c507f-8d99-460b-93c3-53434a0ebbf1 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:10.121680 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f53c507f-8d99-460b-93c3-53434a0ebbf1 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:42:10.129618 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f53c507f-8d99-460b-93c3-53434a0ebbf1 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0" status: 200 len: 1277 microversion: 2.1 time: 0.118999 Jun 29 12:42:10.130210 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 410/842] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:42:10 2022] GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0 => generated 1277 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:42:11.148184 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1e02d892-e978-44ad-8d71-a6b34b4478a8 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:11.148807 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1e02d892-e978-44ad-8d71-a6b34b4478a8 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 4098d777-3800-4629-b323-cdc50b1e7ad0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:11.155578 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1e02d892-e978-44ad-8d71-a6b34b4478a8 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:11.156032 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1e02d892-e978-44ad-8d71-a6b34b4478a8 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:11.156802 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1e02d892-e978-44ad-8d71-a6b34b4478a8 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:11.157242 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1e02d892-e978-44ad-8d71-a6b34b4478a8 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:11.297892 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1e02d892-e978-44ad-8d71-a6b34b4478a8 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:42:11.305745 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1e02d892-e978-44ad-8d71-a6b34b4478a8 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0" status: 200 len: 1319 microversion: 2.1 time: 0.162492 Jun 29 12:42:11.306314 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 433/843] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:42:11 2022] GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:42:11.350294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-a2b79e1d-e9eb-4db3-966a-9ec93d65916b req-ee2acb0d-bd2e-4bf2-bd5f-37de943d8a61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4098d777-3800-4629-b323-cdc50b1e7ad0", "tag": "51aa4b82-8213-493c-b4ba-acce369abd20"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:42:11.359594 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-a2b79e1d-e9eb-4db3-966a-9ec93d65916b req-ee2acb0d-bd2e-4bf2-bd5f-37de943d8a61 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:11.360125 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-a2b79e1d-e9eb-4db3-966a-9ec93d65916b req-ee2acb0d-bd2e-4bf2-bd5f-37de943d8a61 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:11.371997 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-a2b79e1d-e9eb-4db3-966a-9ec93d65916b req-ee2acb0d-bd2e-4bf2-bd5f-37de943d8a61 service nova] Creating event network-changed:51aa4b82-8213-493c-b4ba-acce369abd20 for instance 4098d777-3800-4629-b323-cdc50b1e7ad0 on hv-cinder-81268 Jun 29 12:42:11.376791 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-a2b79e1d-e9eb-4db3-966a-9ec93d65916b req-ee2acb0d-bd2e-4bf2-bd5f-37de943d8a61 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032184 Jun 29 12:42:11.377480 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 411/844] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:42:12.322775 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-716a5d26-f185-4602-99cf-6749bad340c6 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:12.323375 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-716a5d26-f185-4602-99cf-6749bad340c6 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 4098d777-3800-4629-b323-cdc50b1e7ad0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:12.329797 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-716a5d26-f185-4602-99cf-6749bad340c6 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:12.330242 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-716a5d26-f185-4602-99cf-6749bad340c6 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:12.331029 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-716a5d26-f185-4602-99cf-6749bad340c6 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:12.331521 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-716a5d26-f185-4602-99cf-6749bad340c6 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:12.467048 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-716a5d26-f185-4602-99cf-6749bad340c6 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:42:12.474759 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-716a5d26-f185-4602-99cf-6749bad340c6 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0" status: 200 len: 1319 microversion: 2.1 time: 0.155895 Jun 29 12:42:12.475332 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 434/845] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:42:12 2022] GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:42:13.492392 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-137aa29a-9163-40a4-ba1a-1c0df0f259af tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:13.493755 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-137aa29a-9163-40a4-ba1a-1c0df0f259af tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 4098d777-3800-4629-b323-cdc50b1e7ad0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:13.499978 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-137aa29a-9163-40a4-ba1a-1c0df0f259af tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:13.500433 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-137aa29a-9163-40a4-ba1a-1c0df0f259af tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:13.501201 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-137aa29a-9163-40a4-ba1a-1c0df0f259af tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:13.501642 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-137aa29a-9163-40a4-ba1a-1c0df0f259af tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:13.634297 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-137aa29a-9163-40a4-ba1a-1c0df0f259af tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:42:13.642025 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-137aa29a-9163-40a4-ba1a-1c0df0f259af tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0" status: 200 len: 1319 microversion: 2.1 time: 0.154848 Jun 29 12:42:13.642692 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 412/846] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:42:13 2022] GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:42:14.658559 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-916a5a4e-29ad-4b08-97a9-6b1aeb801d3e tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:14.659147 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-916a5a4e-29ad-4b08-97a9-6b1aeb801d3e tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 4098d777-3800-4629-b323-cdc50b1e7ad0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:14.665424 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-916a5a4e-29ad-4b08-97a9-6b1aeb801d3e tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:14.665864 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-916a5a4e-29ad-4b08-97a9-6b1aeb801d3e tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:14.666643 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-916a5a4e-29ad-4b08-97a9-6b1aeb801d3e tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:14.667072 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-916a5a4e-29ad-4b08-97a9-6b1aeb801d3e tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:14.800620 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-916a5a4e-29ad-4b08-97a9-6b1aeb801d3e tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:42:14.807885 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-916a5a4e-29ad-4b08-97a9-6b1aeb801d3e tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0" status: 200 len: 1319 microversion: 2.1 time: 0.153277 Jun 29 12:42:14.808936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 435/847] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:42:14 2022] GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:42:15.562430 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-c51e4ad9-d24f-40fc-902b-203d26683b95 req-e7e25c46-8c01-4379-a122-a875579dc29a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4098d777-3800-4629-b323-cdc50b1e7ad0", "name": "network-vif-plugged", "status": "completed", "tag": "51aa4b82-8213-493c-b4ba-acce369abd20"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:42:15.572020 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-c51e4ad9-d24f-40fc-902b-203d26683b95 req-e7e25c46-8c01-4379-a122-a875579dc29a service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:15.572477 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-c51e4ad9-d24f-40fc-902b-203d26683b95 req-e7e25c46-8c01-4379-a122-a875579dc29a service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:15.584323 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-c51e4ad9-d24f-40fc-902b-203d26683b95 req-e7e25c46-8c01-4379-a122-a875579dc29a service nova] Creating event network-vif-plugged:51aa4b82-8213-493c-b4ba-acce369abd20 for instance 4098d777-3800-4629-b323-cdc50b1e7ad0 on hv-cinder-81268 Jun 29 12:42:15.589175 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-c51e4ad9-d24f-40fc-902b-203d26683b95 req-e7e25c46-8c01-4379-a122-a875579dc29a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030442 Jun 29 12:42:15.589837 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 413/848] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:42:15.824792 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4eca996e-7a51-437f-8912-265c41ca0065 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:15.825408 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4eca996e-7a51-437f-8912-265c41ca0065 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 4098d777-3800-4629-b323-cdc50b1e7ad0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:15.831886 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4eca996e-7a51-437f-8912-265c41ca0065 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:15.832336 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4eca996e-7a51-437f-8912-265c41ca0065 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:15.833161 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4eca996e-7a51-437f-8912-265c41ca0065 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:15.833604 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4eca996e-7a51-437f-8912-265c41ca0065 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:15.966032 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4eca996e-7a51-437f-8912-265c41ca0065 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:42:15.973984 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4eca996e-7a51-437f-8912-265c41ca0065 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0" status: 200 len: 1319 microversion: 2.1 time: 0.152958 Jun 29 12:42:15.974569 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 436/849] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:42:15 2022] GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:42:16.992087 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6e21017f-9272-4a1f-b9a9-75b88d444931 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:16.992787 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6e21017f-9272-4a1f-b9a9-75b88d444931 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 4098d777-3800-4629-b323-cdc50b1e7ad0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:16.998943 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6e21017f-9272-4a1f-b9a9-75b88d444931 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:16.999389 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6e21017f-9272-4a1f-b9a9-75b88d444931 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:17.000138 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6e21017f-9272-4a1f-b9a9-75b88d444931 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:17.000570 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6e21017f-9272-4a1f-b9a9-75b88d444931 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:17.133631 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6e21017f-9272-4a1f-b9a9-75b88d444931 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:42:17.141030 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6e21017f-9272-4a1f-b9a9-75b88d444931 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0" status: 200 len: 1319 microversion: 2.1 time: 0.154222 Jun 29 12:42:17.141593 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 414/850] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:42:16 2022] GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:42:18.157595 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-399e30b4-ca76-43dc-99ce-5f6f6886222f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:18.158202 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-399e30b4-ca76-43dc-99ce-5f6f6886222f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 4098d777-3800-4629-b323-cdc50b1e7ad0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:18.164674 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-399e30b4-ca76-43dc-99ce-5f6f6886222f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:18.165111 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-399e30b4-ca76-43dc-99ce-5f6f6886222f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:18.165853 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-399e30b4-ca76-43dc-99ce-5f6f6886222f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:18.166277 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-399e30b4-ca76-43dc-99ce-5f6f6886222f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:18.297186 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-399e30b4-ca76-43dc-99ce-5f6f6886222f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:42:18.305525 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-399e30b4-ca76-43dc-99ce-5f6f6886222f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0" status: 200 len: 1509 microversion: 2.1 time: 0.151753 Jun 29 12:42:18.306066 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 437/851] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:42:18 2022] GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:42:32.356885 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0e0a3280-bd56-40cf-9c52-b141cc350a9e tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98829183-b8f8-4424-b1dd-38021461eee9", "device": "/dev/sdb"}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:42:32.358588 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0e0a3280-bd56-40cf-9c52-b141cc350a9e tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 4098d777-3800-4629-b323-cdc50b1e7ad0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:32.360729 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:42:32.361379 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=6 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:42:32.362206 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:42:32.362862 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=24 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:42:32.371980 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0e0a3280-bd56-40cf-9c52-b141cc350a9e tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:32.372440 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0e0a3280-bd56-40cf-9c52-b141cc350a9e tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:32.373565 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0e0a3280-bd56-40cf-9c52-b141cc350a9e tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:32.374212 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0e0a3280-bd56-40cf-9c52-b141cc350a9e tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:32.501271 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5b5588f0-b6db-474f-801b-2d4205eaf60a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:32.501833 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5b5588f0-b6db-474f-801b-2d4205eaf60a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:32.503673 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:42:32.504377 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=14 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:42:32.505007 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=31 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:42:32.511541 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5b5588f0-b6db-474f-801b-2d4205eaf60a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:32.512122 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5b5588f0-b6db-474f-801b-2d4205eaf60a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:32.512894 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5b5588f0-b6db-474f-801b-2d4205eaf60a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:32.513333 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5b5588f0-b6db-474f-801b-2d4205eaf60a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:32.538156 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5b5588f0-b6db-474f-801b-2d4205eaf60a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741/ips" status: 200 len: 148 microversion: 2.1 time: 0.040903 Jun 29 12:42:32.538892 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 438/852] 10.222.0.52 () {58 vars in 1247 bytes} [Wed Jun 29 12:42:32 2022] GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:42:32.618445 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0e0a3280-bd56-40cf-9c52-b141cc350a9e tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "POST /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265429 Jun 29 12:42:32.619242 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 415/853] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Jun 29 12:42:32 2022] POST /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:42:33.876598 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-81132f00-80bc-4175-b99a-878927838de0 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6193a60-f48c-48ce-80ea-3bed13ede01d"}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:42:33.877679 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-81132f00-80bc-4175-b99a-878927838de0 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:33.884788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-81132f00-80bc-4175-b99a-878927838de0 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:33.885234 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-81132f00-80bc-4175-b99a-878927838de0 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:33.885986 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-81132f00-80bc-4175-b99a-878927838de0 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:33.886447 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-81132f00-80bc-4175-b99a-878927838de0 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:34.119485 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-81132f00-80bc-4175-b99a-878927838de0 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "POST /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.246727 Jun 29 12:42:34.120106 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 439/854] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Jun 29 12:42:33 2022] POST /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741/os-volume_attachments => generated 194 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:42:48.034383 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:42:48.035177 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:42:48.039665 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d55df2aa-4792-4017-b667-114b3ee882c5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:48.040250 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d55df2aa-4792-4017-b667-114b3ee882c5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:48.047431 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d55df2aa-4792-4017-b667-114b3ee882c5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:48.047884 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d55df2aa-4792-4017-b667-114b3ee882c5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:48.048647 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d55df2aa-4792-4017-b667-114b3ee882c5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:48.049175 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d55df2aa-4792-4017-b667-114b3ee882c5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:48.128255 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-d55df2aa-4792-4017-b667-114b3ee882c5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lazy-loading 'services' on Instance uuid 753cf309-773f-450e-a78f-c705c283a741 {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 12:42:48.198837 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d55df2aa-4792-4017-b667-114b3ee882c5 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "DELETE /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741/os-volume_attachments/b6193a60-f48c-48ce-80ea-3bed13ede01d" status: 202 len: 0 microversion: 2.1 time: 0.165653 Jun 29 12:42:48.199459 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 416/855] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 12:42:48 2022] DELETE /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741/os-volume_attachments/b6193a60-f48c-48ce-80ea-3bed13ede01d => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:42:48.205617 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=4 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:42:48.206856 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:42:48.211506 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-65e5e650-c1ec-410d-a8cc-20b72fec9d6c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:48.212968 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-65e5e650-c1ec-410d-a8cc-20b72fec9d6c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:48.221285 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-65e5e650-c1ec-410d-a8cc-20b72fec9d6c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:48.221735 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-65e5e650-c1ec-410d-a8cc-20b72fec9d6c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:48.222535 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-65e5e650-c1ec-410d-a8cc-20b72fec9d6c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:48.222976 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-65e5e650-c1ec-410d-a8cc-20b72fec9d6c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:48.253786 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-65e5e650-c1ec-410d-a8cc-20b72fec9d6c tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049621 Jun 29 12:42:48.254334 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 440/856] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 12:42:48 2022] GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:42:49.266741 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-42ef6fc4-03e6-4f28-a390-65995cee2ab3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:49.267810 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-42ef6fc4-03e6-4f28-a390-65995cee2ab3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:49.274927 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-42ef6fc4-03e6-4f28-a390-65995cee2ab3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:49.275382 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-42ef6fc4-03e6-4f28-a390-65995cee2ab3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:49.276144 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-42ef6fc4-03e6-4f28-a390-65995cee2ab3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:49.276587 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-42ef6fc4-03e6-4f28-a390-65995cee2ab3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:49.304979 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-42ef6fc4-03e6-4f28-a390-65995cee2ab3 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043213 Jun 29 12:42:49.305644 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 417/857] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 12:42:49 2022] GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:42:50.316136 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-dd365cd5-874f-4564-8154-6bffb2c17b2d tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:50.317113 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-dd365cd5-874f-4564-8154-6bffb2c17b2d tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:50.324677 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dd365cd5-874f-4564-8154-6bffb2c17b2d tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:50.325123 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dd365cd5-874f-4564-8154-6bffb2c17b2d tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:50.325877 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dd365cd5-874f-4564-8154-6bffb2c17b2d tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:50.326312 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dd365cd5-874f-4564-8154-6bffb2c17b2d tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:50.355886 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-dd365cd5-874f-4564-8154-6bffb2c17b2d tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043678 Jun 29 12:42:50.356431 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 441/858] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 12:42:50 2022] GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 12:42:50.414655 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2a23448a-d3c0-44ec-a34d-400e92de5855 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:50.415162 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2a23448a-d3c0-44ec-a34d-400e92de5855 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:50.421838 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2a23448a-d3c0-44ec-a34d-400e92de5855 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:50.422287 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2a23448a-d3c0-44ec-a34d-400e92de5855 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:50.423081 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2a23448a-d3c0-44ec-a34d-400e92de5855 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:50.423516 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2a23448a-d3c0-44ec-a34d-400e92de5855 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:50.449068 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2a23448a-d3c0-44ec-a34d-400e92de5855 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 12:42:50.523993 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2a23448a-d3c0-44ec-a34d-400e92de5855 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "DELETE /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741" status: 204 len: 0 microversion: 2.1 time: 0.113717 Jun 29 12:42:50.524591 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 418/859] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:42:50 2022] DELETE /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 12:42:50.532715 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-533e2cc2-273a-4301-b6f2-0471e5a069e6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:50.533321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-533e2cc2-273a-4301-b6f2-0471e5a069e6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:50.539854 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-533e2cc2-273a-4301-b6f2-0471e5a069e6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:50.540280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-533e2cc2-273a-4301-b6f2-0471e5a069e6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:50.541026 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-533e2cc2-273a-4301-b6f2-0471e5a069e6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:50.541458 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-533e2cc2-273a-4301-b6f2-0471e5a069e6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:50.669090 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-533e2cc2-273a-4301-b6f2-0471e5a069e6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:42:50.676508 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-533e2cc2-273a-4301-b6f2-0471e5a069e6 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741" status: 200 len: 1679 microversion: 2.1 time: 0.147697 Jun 29 12:42:50.677058 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 442/860] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:42:50 2022] GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:42:51.696229 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8091d31f-d380-499b-9d41-4321d119e9cf tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:51.696843 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8091d31f-d380-499b-9d41-4321d119e9cf tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:51.703297 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8091d31f-d380-499b-9d41-4321d119e9cf tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:51.703742 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8091d31f-d380-499b-9d41-4321d119e9cf tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:51.704496 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8091d31f-d380-499b-9d41-4321d119e9cf tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:51.704931 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8091d31f-d380-499b-9d41-4321d119e9cf tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:51.832605 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8091d31f-d380-499b-9d41-4321d119e9cf tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:42:51.840585 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8091d31f-d380-499b-9d41-4321d119e9cf tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741" status: 200 len: 1679 microversion: 2.1 time: 0.149250 Jun 29 12:42:51.841130 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 419/861] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:42:51 2022] GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:42:52.857425 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e25a0d9d-9cdd-45e8-8728-cdcbcf29dd38 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:52.858034 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e25a0d9d-9cdd-45e8-8728-cdcbcf29dd38 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:52.864342 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e25a0d9d-9cdd-45e8-8728-cdcbcf29dd38 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:52.864845 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e25a0d9d-9cdd-45e8-8728-cdcbcf29dd38 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:52.866133 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e25a0d9d-9cdd-45e8-8728-cdcbcf29dd38 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:52.866590 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e25a0d9d-9cdd-45e8-8728-cdcbcf29dd38 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:52.929664 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e25a0d9d-9cdd-45e8-8728-cdcbcf29dd38 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2af4d4a69e9d4755bff61401f4349c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f18ffa75c23e4276a8b5b4fc3821fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:42:52.937063 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e25a0d9d-9cdd-45e8-8728-cdcbcf29dd38 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741" status: 200 len: 1611 microversion: 2.1 time: 0.083435 Jun 29 12:42:52.937646 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 443/862] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:42:52 2022] GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741 => generated 1611 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:42:53.015270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-923e0f5d-c911-4c37-8e66-1749c49e6b09 req-b1c78b7e-9349-40b8-acf9-2ad28c923edb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "753cf309-773f-450e-a78f-c705c283a741", "name": "network-vif-deleted", "tag": "e68bb634-c4ca-4066-b821-2b34535537f8"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:42:53.024940 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-923e0f5d-c911-4c37-8e66-1749c49e6b09 req-b1c78b7e-9349-40b8-acf9-2ad28c923edb service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:53.025348 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-923e0f5d-c911-4c37-8e66-1749c49e6b09 req-b1c78b7e-9349-40b8-acf9-2ad28c923edb service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:53.037945 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-923e0f5d-c911-4c37-8e66-1749c49e6b09 req-b1c78b7e-9349-40b8-acf9-2ad28c923edb service nova] Creating event network-vif-deleted:e68bb634-c4ca-4066-b821-2b34535537f8 for instance 753cf309-773f-450e-a78f-c705c283a741 on hv-cinder-81268 Jun 29 12:42:53.042756 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-923e0f5d-c911-4c37-8e66-1749c49e6b09 req-b1c78b7e-9349-40b8-acf9-2ad28c923edb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031005 Jun 29 12:42:53.043350 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 420/863] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:42:53.212136 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-a60a858b-be4d-4cad-992e-a9071a7e4846 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:53.212657 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-a60a858b-be4d-4cad-992e-a9071a7e4846 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 4098d777-3800-4629-b323-cdc50b1e7ad0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:53.219587 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a60a858b-be4d-4cad-992e-a9071a7e4846 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:53.220119 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a60a858b-be4d-4cad-992e-a9071a7e4846 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:53.220973 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a60a858b-be4d-4cad-992e-a9071a7e4846 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:53.221425 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-a60a858b-be4d-4cad-992e-a9071a7e4846 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:53.313059 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-a60a858b-be4d-4cad-992e-a9071a7e4846 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lazy-loading 'services' on Instance uuid 4098d777-3800-4629-b323-cdc50b1e7ad0 {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 12:42:53.389178 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-a60a858b-be4d-4cad-992e-a9071a7e4846 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0/os-volume_attachments/98829183-b8f8-4424-b1dd-38021461eee9" status: 202 len: 0 microversion: 2.1 time: 0.181426 Jun 29 12:42:53.390082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 444/864] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 12:42:53 2022] DELETE /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0/os-volume_attachments/98829183-b8f8-4424-b1dd-38021461eee9 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:42:53.954880 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c08296cf-9245-403d-b0cd-1958d7aaf046 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:53.955702 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c08296cf-9245-403d-b0cd-1958d7aaf046 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:53.962647 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c08296cf-9245-403d-b0cd-1958d7aaf046 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:53.963108 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c08296cf-9245-403d-b0cd-1958d7aaf046 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:53.963879 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c08296cf-9245-403d-b0cd-1958d7aaf046 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:53.964324 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c08296cf-9245-403d-b0cd-1958d7aaf046 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:53.978658 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-c08296cf-9245-403d-b0cd-1958d7aaf046 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] HTTP exception thrown: Instance 753cf309-773f-450e-a78f-c705c283a741 could not be found. Jun 29 12:42:53.980327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c08296cf-9245-403d-b0cd-1958d7aaf046 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Request method failure captured: Jun 29 12:42:53.980327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741 HTTP/1.1 Jun 29 12:42:53.980327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept: application/json Jun 29 12:42:53.980327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jun 29 12:42:53.980327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Connection: close Jun 29 12:42:53.980327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jun 29 12:42:53.980327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jun 29 12:42:53.980327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Host: 10.222.0.52 Jun 29 12:42:53.980327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jun 29 12:42:53.980327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jun 29 12:42:53.980327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivEe69aM7amLLdDw45pZkO9qxIeRFDOBVDEG3SD63-th4vjx46p2B2ho9vub7AbBeiopTeWWiq0plzI-faJHgEw8JRp3OpSKxo8ZAn9rjDDJbshayaHyBTJQDtsbH4um2iDB62naNRbVeYQvavven9SyQAHp1o14QRaoNvsRRGeWVuWU Jun 29 12:42:53.980327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jun 29 12:42:53.980327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jun 29 12:42:53.980327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jun 29 12:42:53.980327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jun 29 12:42:53.980327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jun 29 12:42:53.980327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jun 29 12:42:53.980327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:42:53.980327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:53.980327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jun 29 12:42:53.980327 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jun 29 12:42:53.981785 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f18ffa75c23e4276a8b5b4fc3821fb87", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:42:53.981785 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:53.981785 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:42:53.981785 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:53.981785 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:42:53.981785 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jun 29 12:42:53.981785 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jun 29 12:42:53.981785 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Id: 2af4d4a69e9d4755bff61401f4349c78 Jun 29 12:42:53.981785 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:42:53.981785 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: method: > Jun 29 12:42:53.981785 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: exception: Instance 753cf309-773f-450e-a78f-c705c283a741 could not be found. Jun 29 12:42:53.981785 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: action_args: {'id': '753cf309-773f-450e-a78f-c705c283a741'} Jun 29 12:42:53.982666 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:42:53.982666 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:53.982666 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:42:53.982666 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:42:53.982666 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:42:53.982666 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:42:53.982666 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:42:53.982666 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:42:53.982666 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:42:53.982666 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:42:53.982666 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 753cf309-773f-450e-a78f-c705c283a741 could not be found. Jun 29 12:42:53.982666 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:42:53.982666 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:42:53.982666 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:42:53.982666 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:53.982666 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:42:53.982666 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:42:53.982666 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:42:53.982666 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:42:53.982666 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:42:53.983962 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:42:53.983962 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:42:53.983962 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:42:53.983962 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:42:53.983962 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:42:53.983962 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:42:53.983962 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:42:53.983962 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 753cf309-773f-450e-a78f-c705c283a741 could not be found. Jun 29 12:42:53.983962 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:42:53.983962 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:42:53.983962 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:42:53.983962 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:53.983962 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:42:53.983962 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:42:53.983962 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:42:53.983962 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:42:53.983962 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 753cf309-773f-450e-a78f-c705c283a741 could not be found. Jun 29 12:42:53.983962 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:42:53.986774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c08296cf-9245-403d-b0cd-1958d7aaf046 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Returning 404 to user: Instance 753cf309-773f-450e-a78f-c705c283a741 could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:42:53.986774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c08296cf-9245-403d-b0cd-1958d7aaf046 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741" status: 404 len: 111 microversion: 2.1 time: 0.031111 Jun 29 12:42:53.986774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 421/865] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:42:53 2022] GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:42:53.991666 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-847484e1-78a5-447d-8fee-41b926d8a634 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '.version_select at 0x7fdb06851f70>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:54.013082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-847484e1-78a5-447d-8fee-41b926d8a634 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-428437870" status: 202 len: 0 microversion: 2.1 time: 0.025929 Jun 29 12:42:54.014762 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 445/866] 10.222.0.52 () {58 vars in 1217 bytes} [Wed Jun 29 12:42:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-428437870 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:42:54.531120 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-63df4047-b309-43c9-a5f0-2c7acd805b8f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:54.531668 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-63df4047-b309-43c9-a5f0-2c7acd805b8f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 4098d777-3800-4629-b323-cdc50b1e7ad0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:54.538729 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-63df4047-b309-43c9-a5f0-2c7acd805b8f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:54.539185 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-63df4047-b309-43c9-a5f0-2c7acd805b8f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:54.539948 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-63df4047-b309-43c9-a5f0-2c7acd805b8f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:54.540388 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-63df4047-b309-43c9-a5f0-2c7acd805b8f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:54.569503 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-63df4047-b309-43c9-a5f0-2c7acd805b8f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 4098d777-3800-4629-b323-cdc50b1e7ad0] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 12:42:54.797121 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-63df4047-b309-43c9-a5f0-2c7acd805b8f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0" status: 204 len: 0 microversion: 2.1 time: 0.269428 Jun 29 12:42:54.797664 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 422/867] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:42:54 2022] DELETE /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 12:42:54.806454 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f99ac56d-245d-4f24-b018-e9c2c74f5436 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:54.807187 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f99ac56d-245d-4f24-b018-e9c2c74f5436 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 4098d777-3800-4629-b323-cdc50b1e7ad0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:54.813336 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f99ac56d-245d-4f24-b018-e9c2c74f5436 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:54.813779 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f99ac56d-245d-4f24-b018-e9c2c74f5436 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:54.814559 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f99ac56d-245d-4f24-b018-e9c2c74f5436 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:54.814990 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f99ac56d-245d-4f24-b018-e9c2c74f5436 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:54.949736 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f99ac56d-245d-4f24-b018-e9c2c74f5436 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:42:54.957235 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f99ac56d-245d-4f24-b018-e9c2c74f5436 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0" status: 200 len: 1515 microversion: 2.1 time: 0.154859 Jun 29 12:42:54.957799 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 446/868] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:42:54 2022] GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:42:55.768430 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-64479847-0e13-48bf-9291-bebf11a18042 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:55.769021 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-64479847-0e13-48bf-9291-bebf11a18042 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:55.776406 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-64479847-0e13-48bf-9291-bebf11a18042 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:55.778011 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-64479847-0e13-48bf-9291-bebf11a18042 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:55.778011 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-64479847-0e13-48bf-9291-bebf11a18042 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:55.780302 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-64479847-0e13-48bf-9291-bebf11a18042 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:55.794796 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-64479847-0e13-48bf-9291-bebf11a18042 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] HTTP exception thrown: Instance 753cf309-773f-450e-a78f-c705c283a741 could not be found. Jun 29 12:42:55.796509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-64479847-0e13-48bf-9291-bebf11a18042 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Request method failure captured: Jun 29 12:42:55.796509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: request: DELETE /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741 HTTP/1.1 Jun 29 12:42:55.796509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept: application/json Jun 29 12:42:55.796509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jun 29 12:42:55.796509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Connection: close Jun 29 12:42:55.796509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jun 29 12:42:55.796509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jun 29 12:42:55.796509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Host: 10.222.0.52 Jun 29 12:42:55.796509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jun 29 12:42:55.796509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jun 29 12:42:55.796509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivEe69aM7amLLdDw45pZkO9qxIeRFDOBVDEG3SD63-th4vjx46p2B2ho9vub7AbBeiopTeWWiq0plzI-faJHgEw8JRp3OpSKxo8ZAn9rjDDJbshayaHyBTJQDtsbH4um2iDB62naNRbVeYQvavven9SyQAHp1o14QRaoNvsRRGeWVuWU Jun 29 12:42:55.796509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jun 29 12:42:55.796509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jun 29 12:42:55.796509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jun 29 12:42:55.796509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jun 29 12:42:55.796509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jun 29 12:42:55.796509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jun 29 12:42:55.796509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:42:55.796509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:55.796509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jun 29 12:42:55.796509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jun 29 12:42:55.798090 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f18ffa75c23e4276a8b5b4fc3821fb87", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:42:55.798090 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:55.798090 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:42:55.798090 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:55.798090 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:42:55.798090 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jun 29 12:42:55.798090 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jun 29 12:42:55.798090 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Id: 2af4d4a69e9d4755bff61401f4349c78 Jun 29 12:42:55.798090 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:42:55.798090 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: method: > Jun 29 12:42:55.798090 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: exception: Instance 753cf309-773f-450e-a78f-c705c283a741 could not be found. Jun 29 12:42:55.798090 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: action_args: {'id': '753cf309-773f-450e-a78f-c705c283a741'} Jun 29 12:42:55.799012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:42:55.799012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:55.799012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:42:55.799012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:42:55.799012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:42:55.799012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:42:55.799012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:42:55.799012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:42:55.799012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:42:55.799012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:42:55.799012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 753cf309-773f-450e-a78f-c705c283a741 could not be found. Jun 29 12:42:55.799012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:42:55.799012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:42:55.799012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:42:55.799012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:55.799012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:42:55.799012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:42:55.799012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:42:55.799012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:42:55.799012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:42:55.800439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:42:55.800439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 12:42:55.800439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 12:42:55.800439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 12:42:55.800439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 12:42:55.800439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:42:55.800439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:42:55.800439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:42:55.800439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:42:55.800439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 753cf309-773f-450e-a78f-c705c283a741 could not be found. Jun 29 12:42:55.800439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:42:55.800439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:42:55.800439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:42:55.800439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:55.800439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:42:55.800439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:42:55.800439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:42:55.800439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:42:55.800439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 753cf309-773f-450e-a78f-c705c283a741 could not be found. Jun 29 12:42:55.800439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:42:55.801844 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-64479847-0e13-48bf-9291-bebf11a18042 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Returning 404 to user: Instance 753cf309-773f-450e-a78f-c705c283a741 could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:42:55.801844 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-64479847-0e13-48bf-9291-bebf11a18042 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "DELETE /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741" status: 404 len: 111 microversion: 2.1 time: 0.033648 Jun 29 12:42:55.801844 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 423/869] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:42:55 2022] DELETE /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:42:55.807536 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6a65fd08-6ebb-44f9-b4e7-b349ef3d0e2f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:55.808147 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-6a65fd08-6ebb-44f9-b4e7-b349ef3d0e2f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: 753cf309-773f-450e-a78f-c705c283a741] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:55.814541 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6a65fd08-6ebb-44f9-b4e7-b349ef3d0e2f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:55.814984 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6a65fd08-6ebb-44f9-b4e7-b349ef3d0e2f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:55.815745 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6a65fd08-6ebb-44f9-b4e7-b349ef3d0e2f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:55.816178 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6a65fd08-6ebb-44f9-b4e7-b349ef3d0e2f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:55.829307 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-6a65fd08-6ebb-44f9-b4e7-b349ef3d0e2f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] HTTP exception thrown: Instance 753cf309-773f-450e-a78f-c705c283a741 could not be found. Jun 29 12:42:55.830963 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6a65fd08-6ebb-44f9-b4e7-b349ef3d0e2f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Request method failure captured: Jun 29 12:42:55.830963 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741 HTTP/1.1 Jun 29 12:42:55.830963 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:42:55.830963 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:42:55.830963 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:42:55.830963 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:42:55.830963 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:42:55.830963 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:42:55.830963 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:42:55.830963 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:42:55.830963 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEe69aM7amLLdDw45pZkO9qxIeRFDOBVDEG3SD63-th4vjx46p2B2ho9vub7AbBeiopTeWWiq0plzI-faJHgEw8JRp3OpSKxo8ZAn9rjDDJbshayaHyBTJQDtsbH4um2iDB62naNRbVeYQvavven9SyQAHp1o14QRaoNvsRRGeWVuWU Jun 29 12:42:55.830963 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:42:55.830963 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:42:55.830963 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:42:55.830963 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:42:55.830963 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:42:55.830963 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:42:55.830963 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:42:55.830963 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:55.830963 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:42:55.830963 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:42:55.832549 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f18ffa75c23e4276a8b5b4fc3821fb87", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:42:55.832549 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:55.832549 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:42:55.832549 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:55.832549 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:42:55.832549 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:42:55.832549 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:42:55.832549 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: 2af4d4a69e9d4755bff61401f4349c78 Jun 29 12:42:55.832549 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:42:55.832549 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:42:55.832549 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Instance 753cf309-773f-450e-a78f-c705c283a741 could not be found. Jun 29 12:42:55.832549 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': '753cf309-773f-450e-a78f-c705c283a741'} Jun 29 12:42:55.837002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:42:55.837002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:55.837002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:42:55.837002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:42:55.837002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:42:55.837002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:42:55.837002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:42:55.837002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:42:55.837002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:42:55.837002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:42:55.837002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 753cf309-773f-450e-a78f-c705c283a741 could not be found. Jun 29 12:42:55.837002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:42:55.837002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:42:55.837002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:42:55.837002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:55.837002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:42:55.837002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:42:55.837002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:42:55.837002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:42:55.837002 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:42:55.839268 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:42:55.839268 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:42:55.839268 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:42:55.839268 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:42:55.839268 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:42:55.839268 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:42:55.839268 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:42:55.839268 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 753cf309-773f-450e-a78f-c705c283a741 could not be found. Jun 29 12:42:55.839268 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:42:55.839268 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:42:55.839268 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:42:55.839268 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:55.839268 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:42:55.839268 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:42:55.839268 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:42:55.839268 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:42:55.839268 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 753cf309-773f-450e-a78f-c705c283a741 could not be found. Jun 29 12:42:55.839268 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:42:55.841867 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6a65fd08-6ebb-44f9-b4e7-b349ef3d0e2f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Returning 404 to user: Instance 753cf309-773f-450e-a78f-c705c283a741 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:42:55.841867 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6a65fd08-6ebb-44f9-b4e7-b349ef3d0e2f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741" status: 404 len: 111 microversion: 2.1 time: 0.028724 Jun 29 12:42:55.841867 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 447/870] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:42:55 2022] GET /compute/v2.1/servers/753cf309-773f-450e-a78f-c705c283a741 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:42:55.974965 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-eb20c371-daab-46c1-91d4-09240a8e35e6 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:55.975576 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-eb20c371-daab-46c1-91d4-09240a8e35e6 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 4098d777-3800-4629-b323-cdc50b1e7ad0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:55.982161 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eb20c371-daab-46c1-91d4-09240a8e35e6 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:55.982650 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eb20c371-daab-46c1-91d4-09240a8e35e6 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:55.983438 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eb20c371-daab-46c1-91d4-09240a8e35e6 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:55.983874 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eb20c371-daab-46c1-91d4-09240a8e35e6 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:56.126838 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-eb20c371-daab-46c1-91d4-09240a8e35e6 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:42:56.135673 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-eb20c371-daab-46c1-91d4-09240a8e35e6 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0" status: 200 len: 1515 microversion: 2.1 time: 0.164513 Jun 29 12:42:56.136224 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 424/871] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:42:55 2022] GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:42:56.784257 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-eb4cd1e2-134f-449e-b9e6-e5f0772b1bc3 req-711f52c0-78f9-47ec-9ebb-fde669c3be4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4098d777-3800-4629-b323-cdc50b1e7ad0", "name": "network-vif-deleted", "tag": "51aa4b82-8213-493c-b4ba-acce369abd20"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:42:56.795357 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-eb4cd1e2-134f-449e-b9e6-e5f0772b1bc3 req-711f52c0-78f9-47ec-9ebb-fde669c3be4c service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:56.795803 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-eb4cd1e2-134f-449e-b9e6-e5f0772b1bc3 req-711f52c0-78f9-47ec-9ebb-fde669c3be4c service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:56.809988 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-eb4cd1e2-134f-449e-b9e6-e5f0772b1bc3 req-711f52c0-78f9-47ec-9ebb-fde669c3be4c service nova] Creating event network-vif-deleted:51aa4b82-8213-493c-b4ba-acce369abd20 for instance 4098d777-3800-4629-b323-cdc50b1e7ad0 on hv-cinder-81268 Jun 29 12:42:56.816452 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-eb4cd1e2-134f-449e-b9e6-e5f0772b1bc3 req-711f52c0-78f9-47ec-9ebb-fde669c3be4c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036180 Jun 29 12:42:56.817432 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 448/872] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:42:56.970477 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b887f672-b142-4472-acc5-c1c8a12c797f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:56.970961 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b887f672-b142-4472-acc5-c1c8a12c797f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d0e0d99d-35d9-455b-944d-3468780b7ec0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:56.978023 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b887f672-b142-4472-acc5-c1c8a12c797f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:56.978494 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b887f672-b142-4472-acc5-c1c8a12c797f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:56.979255 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b887f672-b142-4472-acc5-c1c8a12c797f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:56.979690 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b887f672-b142-4472-acc5-c1c8a12c797f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:56.992612 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-b887f672-b142-4472-acc5-c1c8a12c797f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] HTTP exception thrown: Instance d0e0d99d-35d9-455b-944d-3468780b7ec0 could not be found. Jun 29 12:42:56.994151 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b887f672-b142-4472-acc5-c1c8a12c797f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Request method failure captured: Jun 29 12:42:56.994151 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: request: DELETE /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0 HTTP/1.1 Jun 29 12:42:56.994151 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept: application/json Jun 29 12:42:56.994151 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jun 29 12:42:56.994151 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Connection: close Jun 29 12:42:56.994151 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jun 29 12:42:56.994151 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jun 29 12:42:56.994151 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Host: 10.222.0.52 Jun 29 12:42:56.994151 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jun 29 12:42:56.994151 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jun 29 12:42:56.994151 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivEe69aM7amLLdDw45pZkO9qxIeRFDOBVDEG3SD63-th4vjx46p2B2ho9vub7AbBeiopTeWWiq0plzI-faJHgEw8JRp3OpSKxo8ZAn9rjDDJbshayaHyBTJQDtsbH4um2iDB62naNRbVeYQvavven9SyQAHp1o14QRaoNvsRRGeWVuWU Jun 29 12:42:56.994151 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jun 29 12:42:56.994151 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jun 29 12:42:56.994151 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jun 29 12:42:56.994151 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jun 29 12:42:56.994151 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jun 29 12:42:56.994151 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jun 29 12:42:56.994151 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:42:56.994151 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:56.994151 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jun 29 12:42:56.994151 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jun 29 12:42:56.995818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f18ffa75c23e4276a8b5b4fc3821fb87", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:42:56.995818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:56.995818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:42:56.995818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:56.995818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:42:56.995818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jun 29 12:42:56.995818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jun 29 12:42:56.995818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Id: 2af4d4a69e9d4755bff61401f4349c78 Jun 29 12:42:56.995818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:42:56.995818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: method: > Jun 29 12:42:56.995818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: exception: Instance d0e0d99d-35d9-455b-944d-3468780b7ec0 could not be found. Jun 29 12:42:56.995818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: action_args: {'id': 'd0e0d99d-35d9-455b-944d-3468780b7ec0'} Jun 29 12:42:56.996744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:42:56.996744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:56.996744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:42:56.996744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:42:56.996744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:42:56.996744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:42:56.996744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:42:56.996744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:42:56.996744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:42:56.996744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:42:56.996744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0e0d99d-35d9-455b-944d-3468780b7ec0 could not be found. Jun 29 12:42:56.996744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:42:56.996744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:42:56.996744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:42:56.996744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:56.996744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:42:56.996744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:42:56.996744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:42:56.996744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:42:56.996744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:42:56.998325 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:42:56.998325 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 12:42:56.998325 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 12:42:56.998325 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 12:42:56.998325 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 12:42:56.998325 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:42:56.998325 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:42:56.998325 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:42:56.998325 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:42:56.998325 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0e0d99d-35d9-455b-944d-3468780b7ec0 could not be found. Jun 29 12:42:56.998325 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:42:56.998325 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:42:56.998325 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:42:56.998325 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:56.998325 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:42:56.998325 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:42:56.998325 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:42:56.998325 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:42:56.998325 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0e0d99d-35d9-455b-944d-3468780b7ec0 could not be found. Jun 29 12:42:56.998325 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:42:56.999873 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b887f672-b142-4472-acc5-c1c8a12c797f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Returning 404 to user: Instance d0e0d99d-35d9-455b-944d-3468780b7ec0 could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:42:56.999873 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b887f672-b142-4472-acc5-c1c8a12c797f tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0" status: 404 len: 111 microversion: 2.1 time: 0.028949 Jun 29 12:42:56.999873 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 425/873] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:42:56 2022] DELETE /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:42:57.004360 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-499a3c9a-11c0-4ceb-8c25-d889e771218a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:57.005062 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-499a3c9a-11c0-4ceb-8c25-d889e771218a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d0e0d99d-35d9-455b-944d-3468780b7ec0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:57.011730 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-499a3c9a-11c0-4ceb-8c25-d889e771218a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:57.012180 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-499a3c9a-11c0-4ceb-8c25-d889e771218a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:57.012937 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-499a3c9a-11c0-4ceb-8c25-d889e771218a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:57.013375 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-499a3c9a-11c0-4ceb-8c25-d889e771218a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:57.026962 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-499a3c9a-11c0-4ceb-8c25-d889e771218a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] HTTP exception thrown: Instance d0e0d99d-35d9-455b-944d-3468780b7ec0 could not be found. Jun 29 12:42:57.028564 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-499a3c9a-11c0-4ceb-8c25-d889e771218a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Request method failure captured: Jun 29 12:42:57.028564 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0 HTTP/1.1 Jun 29 12:42:57.028564 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:42:57.028564 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:42:57.028564 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:42:57.028564 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:42:57.028564 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:42:57.028564 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:42:57.028564 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:42:57.028564 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:42:57.028564 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEe69aM7amLLdDw45pZkO9qxIeRFDOBVDEG3SD63-th4vjx46p2B2ho9vub7AbBeiopTeWWiq0plzI-faJHgEw8JRp3OpSKxo8ZAn9rjDDJbshayaHyBTJQDtsbH4um2iDB62naNRbVeYQvavven9SyQAHp1o14QRaoNvsRRGeWVuWU Jun 29 12:42:57.028564 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:42:57.028564 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:42:57.028564 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:42:57.028564 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:42:57.028564 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:42:57.028564 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:42:57.028564 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:42:57.028564 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:57.028564 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:42:57.028564 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:42:57.030306 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f18ffa75c23e4276a8b5b4fc3821fb87", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:42:57.030306 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:57.030306 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:42:57.030306 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:57.030306 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:42:57.030306 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:42:57.030306 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:42:57.030306 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: 2af4d4a69e9d4755bff61401f4349c78 Jun 29 12:42:57.030306 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:42:57.030306 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:42:57.030306 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Instance d0e0d99d-35d9-455b-944d-3468780b7ec0 could not be found. Jun 29 12:42:57.030306 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': 'd0e0d99d-35d9-455b-944d-3468780b7ec0'} Jun 29 12:42:57.031259 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:42:57.031259 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:57.031259 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:42:57.031259 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:42:57.031259 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:42:57.031259 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:42:57.031259 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:42:57.031259 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:42:57.031259 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:42:57.031259 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:42:57.031259 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0e0d99d-35d9-455b-944d-3468780b7ec0 could not be found. Jun 29 12:42:57.031259 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:42:57.031259 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:42:57.031259 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:42:57.031259 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:57.031259 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:42:57.031259 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:42:57.031259 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:42:57.031259 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:42:57.031259 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:42:57.032744 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:42:57.032744 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:42:57.032744 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:42:57.032744 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:42:57.032744 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:42:57.032744 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:42:57.032744 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:42:57.032744 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0e0d99d-35d9-455b-944d-3468780b7ec0 could not be found. Jun 29 12:42:57.032744 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:42:57.032744 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:42:57.032744 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:42:57.032744 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:57.032744 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:42:57.032744 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:42:57.032744 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:42:57.032744 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:42:57.032744 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0e0d99d-35d9-455b-944d-3468780b7ec0 could not be found. Jun 29 12:42:57.032744 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:42:57.034073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-499a3c9a-11c0-4ceb-8c25-d889e771218a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Returning 404 to user: Instance d0e0d99d-35d9-455b-944d-3468780b7ec0 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:42:57.034073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-499a3c9a-11c0-4ceb-8c25-d889e771218a tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0" status: 404 len: 111 microversion: 2.1 time: 0.029705 Jun 29 12:42:57.034073 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 449/874] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:42:56 2022] GET /compute/v2.1/servers/d0e0d99d-35d9-455b-944d-3468780b7ec0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:42:57.039617 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-87e83ba6-64a0-4185-bc2a-79e97783d9b9 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:57.040124 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-87e83ba6-64a0-4185-bc2a-79e97783d9b9 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:57.046138 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-87e83ba6-64a0-4185-bc2a-79e97783d9b9 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:57.046626 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-87e83ba6-64a0-4185-bc2a-79e97783d9b9 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:57.047387 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-87e83ba6-64a0-4185-bc2a-79e97783d9b9 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:57.047824 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-87e83ba6-64a0-4185-bc2a-79e97783d9b9 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:57.061728 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-87e83ba6-64a0-4185-bc2a-79e97783d9b9 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] HTTP exception thrown: Instance d363d4d7-f546-4939-9ac6-bd4eb1118338 could not be found. Jun 29 12:42:57.063294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-87e83ba6-64a0-4185-bc2a-79e97783d9b9 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Request method failure captured: Jun 29 12:42:57.063294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: request: DELETE /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 HTTP/1.1 Jun 29 12:42:57.063294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept: application/json Jun 29 12:42:57.063294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jun 29 12:42:57.063294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Connection: close Jun 29 12:42:57.063294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jun 29 12:42:57.063294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jun 29 12:42:57.063294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Host: 10.222.0.52 Jun 29 12:42:57.063294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jun 29 12:42:57.063294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jun 29 12:42:57.063294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivEe69aM7amLLdDw45pZkO9qxIeRFDOBVDEG3SD63-th4vjx46p2B2ho9vub7AbBeiopTeWWiq0plzI-faJHgEw8JRp3OpSKxo8ZAn9rjDDJbshayaHyBTJQDtsbH4um2iDB62naNRbVeYQvavven9SyQAHp1o14QRaoNvsRRGeWVuWU Jun 29 12:42:57.063294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jun 29 12:42:57.063294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jun 29 12:42:57.063294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jun 29 12:42:57.063294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jun 29 12:42:57.063294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jun 29 12:42:57.063294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jun 29 12:42:57.063294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:42:57.063294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:57.063294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jun 29 12:42:57.063294 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jun 29 12:42:57.064922 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f18ffa75c23e4276a8b5b4fc3821fb87", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:42:57.064922 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:57.064922 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:42:57.064922 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:57.064922 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:42:57.064922 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jun 29 12:42:57.064922 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jun 29 12:42:57.064922 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Id: 2af4d4a69e9d4755bff61401f4349c78 Jun 29 12:42:57.064922 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:42:57.064922 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: method: > Jun 29 12:42:57.064922 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: exception: Instance d363d4d7-f546-4939-9ac6-bd4eb1118338 could not be found. Jun 29 12:42:57.064922 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: action_args: {'id': 'd363d4d7-f546-4939-9ac6-bd4eb1118338'} Jun 29 12:42:57.065818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:42:57.065818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:57.065818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:42:57.065818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:42:57.065818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:42:57.065818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:42:57.065818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:42:57.065818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:42:57.065818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:42:57.065818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:42:57.065818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d363d4d7-f546-4939-9ac6-bd4eb1118338 could not be found. Jun 29 12:42:57.065818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:42:57.065818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:42:57.065818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:42:57.065818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:57.065818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:42:57.065818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:42:57.065818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:42:57.065818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:42:57.065818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:42:57.067318 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:42:57.067318 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 12:42:57.067318 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 12:42:57.067318 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 12:42:57.067318 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 12:42:57.067318 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:42:57.067318 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:42:57.067318 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:42:57.067318 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:42:57.067318 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d363d4d7-f546-4939-9ac6-bd4eb1118338 could not be found. Jun 29 12:42:57.067318 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:42:57.067318 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:42:57.067318 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:42:57.067318 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:57.067318 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:42:57.067318 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:42:57.067318 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:42:57.067318 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:42:57.067318 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d363d4d7-f546-4939-9ac6-bd4eb1118338 could not be found. Jun 29 12:42:57.067318 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:42:57.068735 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-87e83ba6-64a0-4185-bc2a-79e97783d9b9 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Returning 404 to user: Instance d363d4d7-f546-4939-9ac6-bd4eb1118338 could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:42:57.068735 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-87e83ba6-64a0-4185-bc2a-79e97783d9b9 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338" status: 404 len: 111 microversion: 2.1 time: 0.030077 Jun 29 12:42:57.068735 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 426/875] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:42:57 2022] DELETE /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:42:57.073561 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3506f194-f036-4ad7-8551-0abe10d62b15 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:57.074168 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3506f194-f036-4ad7-8551-0abe10d62b15 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: d363d4d7-f546-4939-9ac6-bd4eb1118338] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:57.080104 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3506f194-f036-4ad7-8551-0abe10d62b15 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:57.080557 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3506f194-f036-4ad7-8551-0abe10d62b15 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:57.081297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3506f194-f036-4ad7-8551-0abe10d62b15 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:57.081726 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3506f194-f036-4ad7-8551-0abe10d62b15 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:57.097484 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-3506f194-f036-4ad7-8551-0abe10d62b15 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] HTTP exception thrown: Instance d363d4d7-f546-4939-9ac6-bd4eb1118338 could not be found. Jun 29 12:42:57.099538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3506f194-f036-4ad7-8551-0abe10d62b15 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Request method failure captured: Jun 29 12:42:57.099538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 HTTP/1.1 Jun 29 12:42:57.099538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:42:57.099538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:42:57.099538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:42:57.099538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:42:57.099538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:42:57.099538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:42:57.099538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:42:57.099538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:42:57.099538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEe69aM7amLLdDw45pZkO9qxIeRFDOBVDEG3SD63-th4vjx46p2B2ho9vub7AbBeiopTeWWiq0plzI-faJHgEw8JRp3OpSKxo8ZAn9rjDDJbshayaHyBTJQDtsbH4um2iDB62naNRbVeYQvavven9SyQAHp1o14QRaoNvsRRGeWVuWU Jun 29 12:42:57.099538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:42:57.099538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:42:57.099538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:42:57.099538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:42:57.099538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:42:57.099538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:42:57.099538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:42:57.099538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:57.099538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:42:57.099538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:42:57.101772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f18ffa75c23e4276a8b5b4fc3821fb87", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:42:57.101772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:57.101772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:42:57.101772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:57.101772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:42:57.101772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:42:57.101772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:42:57.101772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: 2af4d4a69e9d4755bff61401f4349c78 Jun 29 12:42:57.101772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:42:57.101772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:42:57.101772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Instance d363d4d7-f546-4939-9ac6-bd4eb1118338 could not be found. Jun 29 12:42:57.101772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': 'd363d4d7-f546-4939-9ac6-bd4eb1118338'} Jun 29 12:42:57.103057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:42:57.103057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:57.103057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:42:57.103057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:42:57.103057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:42:57.103057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:42:57.103057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:42:57.103057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:42:57.103057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:42:57.103057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:42:57.103057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d363d4d7-f546-4939-9ac6-bd4eb1118338 could not be found. Jun 29 12:42:57.103057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:42:57.103057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:42:57.103057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:42:57.103057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:57.103057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:42:57.103057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:42:57.103057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:42:57.103057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:42:57.103057 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:42:57.104454 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:42:57.104454 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:42:57.104454 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:42:57.104454 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:42:57.104454 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:42:57.104454 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:42:57.104454 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:42:57.104454 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d363d4d7-f546-4939-9ac6-bd4eb1118338 could not be found. Jun 29 12:42:57.104454 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:42:57.104454 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:42:57.104454 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:42:57.104454 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:57.104454 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:42:57.104454 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:42:57.104454 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:42:57.104454 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:42:57.104454 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d363d4d7-f546-4939-9ac6-bd4eb1118338 could not be found. Jun 29 12:42:57.104454 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:42:57.105553 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3506f194-f036-4ad7-8551-0abe10d62b15 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Returning 404 to user: Instance d363d4d7-f546-4939-9ac6-bd4eb1118338 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:42:57.105553 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3506f194-f036-4ad7-8551-0abe10d62b15 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338" status: 404 len: 111 microversion: 2.1 time: 0.031769 Jun 29 12:42:57.105553 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 450/876] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:42:57 2022] GET /compute/v2.1/servers/d363d4d7-f546-4939-9ac6-bd4eb1118338 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:42:57.156364 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1a985dba-9c04-4c04-8d7a-8e10be9a056f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:57.156969 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-1a985dba-9c04-4c04-8d7a-8e10be9a056f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 4098d777-3800-4629-b323-cdc50b1e7ad0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:57.168193 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1a985dba-9c04-4c04-8d7a-8e10be9a056f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:57.168728 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1a985dba-9c04-4c04-8d7a-8e10be9a056f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:57.169762 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1a985dba-9c04-4c04-8d7a-8e10be9a056f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:57.170291 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1a985dba-9c04-4c04-8d7a-8e10be9a056f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:57.206243 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1a985dba-9c04-4c04-8d7a-8e10be9a056f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:57.206404 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-1a985dba-9c04-4c04-8d7a-8e10be9a056f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:57.207475 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-1a985dba-9c04-4c04-8d7a-8e10be9a056f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lazy-loading 'fault' on Instance uuid 4098d777-3800-4629-b323-cdc50b1e7ad0 {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 12:42:57.254443 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-1a985dba-9c04-4c04-8d7a-8e10be9a056f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:42:57.261981 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-1a985dba-9c04-4c04-8d7a-8e10be9a056f tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0" status: 200 len: 1309 microversion: 2.1 time: 0.109711 Jun 29 12:42:57.262585 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 427/877] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:42:57 2022] GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0 => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:42:58.251821 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-edfeca38-2748-4329-8325-5b25ee40a260 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:58.252312 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-edfeca38-2748-4329-8325-5b25ee40a260 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: c8419121-12d7-431e-9ff0-dfa04c64cd00] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:58.258830 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-edfeca38-2748-4329-8325-5b25ee40a260 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:58.259274 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-edfeca38-2748-4329-8325-5b25ee40a260 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:58.260029 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-edfeca38-2748-4329-8325-5b25ee40a260 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:58.260460 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-edfeca38-2748-4329-8325-5b25ee40a260 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:58.274256 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-edfeca38-2748-4329-8325-5b25ee40a260 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] HTTP exception thrown: Instance c8419121-12d7-431e-9ff0-dfa04c64cd00 could not be found. Jun 29 12:42:58.275821 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-edfeca38-2748-4329-8325-5b25ee40a260 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Request method failure captured: Jun 29 12:42:58.275821 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: DELETE /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00 HTTP/1.1 Jun 29 12:42:58.275821 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:42:58.275821 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:42:58.275821 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:42:58.275821 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:42:58.275821 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:42:58.275821 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:42:58.275821 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:42:58.275821 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:42:58.275821 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEe69aM7amLLdDw45pZkO9qxIeRFDOBVDEG3SD63-th4vjx46p2B2ho9vub7AbBeiopTeWWiq0plzI-faJHgEw8JRp3OpSKxo8ZAn9rjDDJbshayaHyBTJQDtsbH4um2iDB62naNRbVeYQvavven9SyQAHp1o14QRaoNvsRRGeWVuWU Jun 29 12:42:58.275821 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:42:58.275821 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:42:58.275821 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:42:58.275821 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:42:58.275821 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:42:58.275821 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:42:58.275821 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:42:58.275821 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:58.275821 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:42:58.275821 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:42:58.277428 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f18ffa75c23e4276a8b5b4fc3821fb87", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:42:58.277428 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:58.277428 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:42:58.277428 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:58.277428 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:42:58.277428 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:42:58.277428 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:42:58.277428 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: 2af4d4a69e9d4755bff61401f4349c78 Jun 29 12:42:58.277428 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:42:58.277428 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:42:58.277428 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Instance c8419121-12d7-431e-9ff0-dfa04c64cd00 could not be found. Jun 29 12:42:58.277428 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': 'c8419121-12d7-431e-9ff0-dfa04c64cd00'} Jun 29 12:42:58.278261 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:42:58.278261 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:58.278261 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:42:58.278261 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:42:58.278261 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:42:58.278261 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:42:58.278261 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:42:58.278261 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:42:58.278261 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:42:58.278261 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:42:58.278261 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8419121-12d7-431e-9ff0-dfa04c64cd00 could not be found. Jun 29 12:42:58.278261 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:42:58.278261 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:42:58.278261 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:42:58.278261 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:58.278261 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:42:58.278261 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:42:58.278261 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:42:58.278261 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:42:58.278261 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:42:58.279772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:42:58.279772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 12:42:58.279772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 12:42:58.279772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 12:42:58.279772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 12:42:58.279772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:42:58.279772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:42:58.279772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:42:58.279772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:42:58.279772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8419121-12d7-431e-9ff0-dfa04c64cd00 could not be found. Jun 29 12:42:58.279772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:42:58.279772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:42:58.279772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:42:58.279772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:58.279772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:42:58.279772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:42:58.279772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:42:58.279772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:42:58.279772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8419121-12d7-431e-9ff0-dfa04c64cd00 could not be found. Jun 29 12:42:58.279772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:42:58.281243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-edfeca38-2748-4329-8325-5b25ee40a260 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Returning 404 to user: Instance c8419121-12d7-431e-9ff0-dfa04c64cd00 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:42:58.281243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-edfeca38-2748-4329-8325-5b25ee40a260 tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00" status: 404 len: 111 microversion: 2.1 time: 0.029252 Jun 29 12:42:58.281243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 451/878] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:42:58 2022] DELETE /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:42:58.282158 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d305ce17-4c21-41a3-9dfa-c94c5d33f08a tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:58.282928 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d305ce17-4c21-41a3-9dfa-c94c5d33f08a tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 4098d777-3800-4629-b323-cdc50b1e7ad0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:58.285056 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3cd766d5-9b95-48e9-a97b-501e6ce027ba tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:42:58.285659 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3cd766d5-9b95-48e9-a97b-501e6ce027ba tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] [instance: c8419121-12d7-431e-9ff0-dfa04c64cd00] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:42:58.290202 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d305ce17-4c21-41a3-9dfa-c94c5d33f08a tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:58.290676 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d305ce17-4c21-41a3-9dfa-c94c5d33f08a tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:58.291432 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d305ce17-4c21-41a3-9dfa-c94c5d33f08a tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:58.291868 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d305ce17-4c21-41a3-9dfa-c94c5d33f08a tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:58.292059 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3cd766d5-9b95-48e9-a97b-501e6ce027ba tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:58.292505 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3cd766d5-9b95-48e9-a97b-501e6ce027ba tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:58.293262 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3cd766d5-9b95-48e9-a97b-501e6ce027ba tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:42:58.293699 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3cd766d5-9b95-48e9-a97b-501e6ce027ba tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:42:58.305095 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-d305ce17-4c21-41a3-9dfa-c94c5d33f08a tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] HTTP exception thrown: Instance 4098d777-3800-4629-b323-cdc50b1e7ad0 could not be found. Jun 29 12:42:58.306661 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d305ce17-4c21-41a3-9dfa-c94c5d33f08a tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Request method failure captured: Jun 29 12:42:58.306661 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0 HTTP/1.1 Jun 29 12:42:58.306661 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept: application/json Jun 29 12:42:58.306661 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jun 29 12:42:58.306661 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Connection: close Jun 29 12:42:58.306661 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jun 29 12:42:58.306661 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jun 29 12:42:58.306661 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Host: 10.222.0.52 Jun 29 12:42:58.306661 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jun 29 12:42:58.306661 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jun 29 12:42:58.306661 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivEiewQy9TttkKxsYHeD6KJMAHlidh8TtskpUir_TWGpKeapFRAabmklXxVbtrLzGEDZOHZzBp4PKYNdYkxK2EtP7WN4kDK9d-GC6ftWvHd3aGAnXrPv8lNSPcm74ANvdRvq6V0CQkFBflThd1HnRg_Op65gZwWnViK4RLlj4xNDuK8k Jun 29 12:42:58.306661 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jun 29 12:42:58.306661 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jun 29 12:42:58.306661 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jun 29 12:42:58.306661 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jun 29 12:42:58.306661 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jun 29 12:42:58.306661 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jun 29 12:42:58.306661 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Id: e1ba9e59fe574391a0c8342daed01416 Jun 29 12:42:58.306661 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-VolumesSnapshotTestJSON-353834511 Jun 29 12:42:58.306661 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jun 29 12:42:58.306661 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jun 29 12:42:58.308279 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e1ba9e59fe574391a0c8342daed01416", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e1ba9e59fe574391a0c8342daed01416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e1ba9e59fe574391a0c8342daed01416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e1ba9e59fe574391a0c8342daed01416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:42:58.308279 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-VolumesSnapshotTestJSON-353834511 Jun 29 12:42:58.308279 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Id: e1ba9e59fe574391a0c8342daed01416 Jun 29 12:42:58.308279 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-353834511 Jun 29 12:42:58.308279 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User: tempest-VolumesSnapshotTestJSON-353834511-project Jun 29 12:42:58.308279 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jun 29 12:42:58.308279 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jun 29 12:42:58.308279 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Id: eb9bae5e3522437182d2650c3fcfdef6 Jun 29 12:42:58.308279 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-VolumesSnapshotTestJSON-353834511-project Jun 29 12:42:58.308279 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: method: > Jun 29 12:42:58.308279 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: exception: Instance 4098d777-3800-4629-b323-cdc50b1e7ad0 could not be found. Jun 29 12:42:58.308279 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: action_args: {'id': '4098d777-3800-4629-b323-cdc50b1e7ad0'} Jun 29 12:42:58.309105 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:42:58.309105 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:58.309105 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:42:58.309105 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:42:58.309105 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:42:58.309105 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:42:58.309105 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:42:58.309105 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:42:58.309105 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:42:58.309105 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:42:58.309105 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4098d777-3800-4629-b323-cdc50b1e7ad0 could not be found. Jun 29 12:42:58.309105 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:42:58.309105 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:42:58.309105 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:42:58.309105 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:58.309105 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:42:58.309105 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:42:58.309105 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:42:58.309105 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:42:58.309105 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:42:58.310317 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:42:58.310317 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:42:58.310317 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:42:58.310317 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:42:58.310317 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:42:58.310317 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:42:58.310317 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:42:58.310317 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4098d777-3800-4629-b323-cdc50b1e7ad0 could not be found. Jun 29 12:42:58.310317 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:42:58.310317 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:42:58.310317 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:42:58.310317 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:58.310317 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:42:58.310317 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:42:58.310317 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:42:58.310317 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:42:58.310317 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4098d777-3800-4629-b323-cdc50b1e7ad0 could not be found. Jun 29 12:42:58.310317 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:42:58.311642 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-3cd766d5-9b95-48e9-a97b-501e6ce027ba tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] HTTP exception thrown: Instance c8419121-12d7-431e-9ff0-dfa04c64cd00 could not be found. Jun 29 12:42:58.311747 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d305ce17-4c21-41a3-9dfa-c94c5d33f08a tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Returning 404 to user: Instance 4098d777-3800-4629-b323-cdc50b1e7ad0 could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:42:58.311747 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d305ce17-4c21-41a3-9dfa-c94c5d33f08a tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0" status: 404 len: 111 microversion: 2.1 time: 0.032364 Jun 29 12:42:58.311956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3cd766d5-9b95-48e9-a97b-501e6ce027ba tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Request method failure captured: Jun 29 12:42:58.311956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00 HTTP/1.1 Jun 29 12:42:58.311956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:42:58.311956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:42:58.311956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:42:58.311956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:42:58.311956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:42:58.311956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:42:58.311956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:42:58.311956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:42:58.311956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEe69aM7amLLdDw45pZkO9qxIeRFDOBVDEG3SD63-th4vjx46p2B2ho9vub7AbBeiopTeWWiq0plzI-faJHgEw8JRp3OpSKxo8ZAn9rjDDJbshayaHyBTJQDtsbH4um2iDB62naNRbVeYQvavven9SyQAHp1o14QRaoNvsRRGeWVuWU Jun 29 12:42:58.311956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:42:58.311956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:42:58.311956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:42:58.311956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:42:58.311956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:42:58.311956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:42:58.311956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:42:58.311956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:58.311956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:42:58.311956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:42:58.313424 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f18ffa75c23e4276a8b5b4fc3821fb87", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f18ffa75c23e4276a8b5b4fc3821fb87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:42:58.313424 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:58.313424 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: f18ffa75c23e4276a8b5b4fc3821fb87 Jun 29 12:42:58.313424 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1250841024 Jun 29 12:42:58.313424 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:42:58.313424 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:42:58.313424 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:42:58.313424 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: 2af4d4a69e9d4755bff61401f4349c78 Jun 29 12:42:58.313424 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-AttachVolumeNegativeTest-1250841024-project Jun 29 12:42:58.313424 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:42:58.313424 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Instance c8419121-12d7-431e-9ff0-dfa04c64cd00 could not be found. Jun 29 12:42:58.313424 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': 'c8419121-12d7-431e-9ff0-dfa04c64cd00'} Jun 29 12:42:58.314321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:42:58.314321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:58.314321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:42:58.314321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:42:58.314321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:42:58.314321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:42:58.314321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:42:58.314321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:42:58.314321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:42:58.314321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:42:58.314321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8419121-12d7-431e-9ff0-dfa04c64cd00 could not be found. Jun 29 12:42:58.314321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:42:58.314321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:42:58.314321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:42:58.314321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:58.314321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:42:58.314321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:42:58.314321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:42:58.314321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:42:58.314321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:42:58.315621 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:42:58.315621 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:42:58.315621 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:42:58.315621 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:42:58.315621 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:42:58.315621 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:42:58.315621 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:42:58.315621 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8419121-12d7-431e-9ff0-dfa04c64cd00 could not be found. Jun 29 12:42:58.315621 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:42:58.315621 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:42:58.315621 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:42:58.315621 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:42:58.315621 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:42:58.315621 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:42:58.315621 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:42:58.315621 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:42:58.315621 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8419121-12d7-431e-9ff0-dfa04c64cd00 could not be found. Jun 29 12:42:58.315621 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:42:58.317083 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3cd766d5-9b95-48e9-a97b-501e6ce027ba tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] Returning 404 to user: Instance c8419121-12d7-431e-9ff0-dfa04c64cd00 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:42:58.317171 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 428/879] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:42:58 2022] GET /compute/v2.1/servers/4098d777-3800-4629-b323-cdc50b1e7ad0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:42:58.318142 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3cd766d5-9b95-48e9-a97b-501e6ce027ba tempest-AttachVolumeNegativeTest-1250841024 tempest-AttachVolumeNegativeTest-1250841024-project] 10.222.0.52 "GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00" status: 404 len: 111 microversion: 2.1 time: 0.028028 Jun 29 12:42:58.318142 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 452/880] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:42:58 2022] GET /compute/v2.1/servers/c8419121-12d7-431e-9ff0-dfa04c64cd00 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:43:03.913116 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-a0075ec8-fdfc-49a5-858e-210ac2ef2ce9 tempest-VolumesTestJSON-1946084767 tempest-VolumesTestJSON-1946084767-project] Calling method '.version_select at 0x7fdb067898b0>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:03.960566 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-a0075ec8-fdfc-49a5-858e-210ac2ef2ce9 tempest-VolumesTestJSON-1946084767 tempest-VolumesTestJSON-1946084767-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/4ebc6e7a-4345-4249-95a9-9cb8a46203e4" status: 200 len: 349 microversion: 2.1 time: 0.051048 Jun 29 12:43:03.961126 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 429/881] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 12:43:03 2022] GET /compute/v2.1/os-volumes/4ebc6e7a-4345-4249-95a9-9cb8a46203e4 => generated 349 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:43:06.178843 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-282bcd7f-8873-40fe-b72a-b929e423b781 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1407459525", "imageRef": "70887696-f652-46b0-a5be-bfb400986078", "flavorRef": "452", "networks": [{"uuid": "1fa0fcca-656c-4166-b81d-3710eb67922d"}]}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:43:06.232405 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.network.neutron [None req-282bcd7f-8873-40fe-b72a-b929e423b781 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] validate_networks() for [('1fa0fcca-656c-4166-b81d-3710eb67922d', None, None, None, None, None)] {{(pid=124317) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 12:43:06.328472 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-bdd0c5e9-56a8-41dc-9572-4972acaa8cc0 tempest-VolumesTestJSON-1946084767 tempest-VolumesTestJSON-1946084767-project] Calling method '.version_select at 0x7fdb06837b80>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:06.379237 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-bdd0c5e9-56a8-41dc-9572-4972acaa8cc0 tempest-VolumesTestJSON-1946084767 tempest-VolumesTestJSON-1946084767-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/63c99be4-42b0-4dd6-a031-c78bdebb14fa" status: 200 len: 351 microversion: 2.1 time: 0.055059 Jun 29 12:43:06.379880 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 430/882] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 12:43:06 2022] GET /compute/v2.1/os-volumes/63c99be4-42b0-4dd6-a031-c78bdebb14fa => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:43:06.845533 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-282bcd7f-8873-40fe-b72a-b929e423b781 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Flavor limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 12:43:06.845985 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-282bcd7f-8873-40fe-b72a-b929e423b781 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Image limits 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 12:43:06.846488 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-282bcd7f-8873-40fe-b72a-b929e423b781 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Flavor pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 12:43:06.846926 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-282bcd7f-8873-40fe-b72a-b929e423b781 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Image pref 0:0:0 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 12:43:06.847354 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.virt.hardware [None req-282bcd7f-8873-40fe-b72a-b929e423b781 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124317) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 12:43:06.857141 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-282bcd7f-8873-40fe-b72a-b929e423b781 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:06.857585 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-282bcd7f-8873-40fe-b72a-b929e423b781 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:06.858373 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-282bcd7f-8873-40fe-b72a-b929e423b781 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:06.858852 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-282bcd7f-8873-40fe-b72a-b929e423b781 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:06.875938 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-282bcd7f-8873-40fe-b72a-b929e423b781 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Getting quotas for project e1ba9e59fe574391a0c8342daed01416. Resources: {'cores', 'ram', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:43:06.879878 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-282bcd7f-8873-40fe-b72a-b929e423b781 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Getting quotas for user eb9bae5e3522437182d2650c3fcfdef6 and project e1ba9e59fe574391a0c8342daed01416. Resources: {'cores', 'ram', 'instances'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:43:06.891324 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-282bcd7f-8873-40fe-b72a-b929e423b781 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Going to run 1 instances... {{(pid=124317) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 12:43:06.893554 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-282bcd7f-8873-40fe-b72a-b929e423b781 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 06d49d38-a3bd-4345-9cae-f02900b8ccb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70887696-f652-46b0-a5be-bfb400986078',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124317) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 12:43:06.939506 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-282bcd7f-8873-40fe-b72a-b929e423b781 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.764516 Jun 29 12:43:06.940134 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 453/883] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 12:43:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 12:43:06.950644 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-1b1c2520-533c-4207-9550-7a197962893c tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:06.951263 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-1b1c2520-533c-4207-9550-7a197962893c tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 06d49d38-a3bd-4345-9cae-f02900b8ccb4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:43:07.009190 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-1b1c2520-533c-4207-9550-7a197962893c tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:43:07.015877 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-1b1c2520-533c-4207-9550-7a197962893c tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4" status: 200 len: 1219 microversion: 2.1 time: 0.069085 Jun 29 12:43:07.016500 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 431/884] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:43:06 2022] GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:43:07.723527 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8d38f46e-66cf-4adf-9a34-43443ef2601f tempest-VolumesTestJSON-1946084767 tempest-VolumesTestJSON-1946084767-project] Calling method '.version_select at 0x7fdb068b33a0>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:07.774148 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8d38f46e-66cf-4adf-9a34-43443ef2601f tempest-VolumesTestJSON-1946084767 tempest-VolumesTestJSON-1946084767-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/aad2fd1f-d6bb-418b-9840-bad019ab75ea" status: 200 len: 351 microversion: 2.1 time: 0.054798 Jun 29 12:43:07.775094 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 454/885] 10.222.0.52 () {58 vars in 1244 bytes} [Wed Jun 29 12:43:07 2022] GET /compute/v2.1/os-volumes/aad2fd1f-d6bb-418b-9840-bad019ab75ea => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:43:07.786080 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-57eb7161-2931-4c92-ac55-b79d4ed54bab tempest-VolumesTestJSON-1946084767 tempest-VolumesTestJSON-1946084767-project] Calling method '.version_select at 0x7fdb0680dee0>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:07.878475 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-57eb7161-2931-4c92-ac55-b79d4ed54bab tempest-VolumesTestJSON-1946084767 tempest-VolumesTestJSON-1946084767-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.095458 Jun 29 12:43:07.880521 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 432/886] 10.222.0.52 () {58 vars in 1133 bytes} [Wed Jun 29 12:43:07 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:43:07.893321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-834649cd-bb42-4d2a-a2da-f17e958a6494 tempest-VolumesTestJSON-1946084767 tempest-VolumesTestJSON-1946084767-project] Calling method '.version_select at 0x7fdb06810e50>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:07.980373 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-834649cd-bb42-4d2a-a2da-f17e958a6494 tempest-VolumesTestJSON-1946084767 tempest-VolumesTestJSON-1946084767-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.090853 Jun 29 12:43:07.981178 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 455/887] 10.222.0.52 () {58 vars in 1148 bytes} [Wed Jun 29 12:43:07 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:43:07.993670 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5ca3fcb4-f7c6-4f70-9535-7f48d598196f tempest-VolumesTestJSON-1946084767 tempest-VolumesTestJSON-1946084767-project] Calling method '.version_select at 0x7fdb06892ee0>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:08.033217 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-70a93f69-7fe7-4ec8-8cd4-bf7ab7ee5e2b tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:08.034003 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-70a93f69-7fe7-4ec8-8cd4-bf7ab7ee5e2b tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 06d49d38-a3bd-4345-9cae-f02900b8ccb4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:43:08.041136 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-70a93f69-7fe7-4ec8-8cd4-bf7ab7ee5e2b tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:08.041910 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-70a93f69-7fe7-4ec8-8cd4-bf7ab7ee5e2b tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:08.042863 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-70a93f69-7fe7-4ec8-8cd4-bf7ab7ee5e2b tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:08.043367 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-70a93f69-7fe7-4ec8-8cd4-bf7ab7ee5e2b tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:08.078534 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5ca3fcb4-f7c6-4f70-9535-7f48d598196f tempest-VolumesTestJSON-1946084767 tempest-VolumesTestJSON-1946084767-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.089312 Jun 29 12:43:08.079662 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 433/888] 10.222.0.52 () {58 vars in 1133 bytes} [Wed Jun 29 12:43:07 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:43:08.091129 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ed135c6a-a376-45dd-a60b-84d30b86dac2 tempest-VolumesTestJSON-1946084767 tempest-VolumesTestJSON-1946084767-project] Calling method '.version_select at 0x7fdb069c31f0>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:08.115927 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-70a93f69-7fe7-4ec8-8cd4-bf7ab7ee5e2b tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:43:08.124055 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-70a93f69-7fe7-4ec8-8cd4-bf7ab7ee5e2b tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4" status: 200 len: 1277 microversion: 2.1 time: 0.094834 Jun 29 12:43:08.124934 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 456/889] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:43:08 2022] GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4 => generated 1277 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:43:08.179415 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ed135c6a-a376-45dd-a60b-84d30b86dac2 tempest-VolumesTestJSON-1946084767 tempest-VolumesTestJSON-1946084767-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091750 Jun 29 12:43:08.179947 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 434/890] 10.222.0.52 () {58 vars in 1166 bytes} [Wed Jun 29 12:43:08 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:43:08.191782 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5fb46368-3b42-4110-8a06-3e1402e5082f tempest-VolumesTestJSON-1946084767 tempest-VolumesTestJSON-1946084767-project] Calling method '.version_select at 0x7fdb068204c0>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:08.273466 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5fb46368-3b42-4110-8a06-3e1402e5082f tempest-VolumesTestJSON-1946084767 tempest-VolumesTestJSON-1946084767-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085217 Jun 29 12:43:08.274122 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 457/891] 10.222.0.52 () {58 vars in 1169 bytes} [Wed Jun 29 12:43:08 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:43:08.285663 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-10fb33af-0501-4bb0-a9c4-6ca8bc4bfca6 tempest-VolumesTestJSON-1946084767 tempest-VolumesTestJSON-1946084767-project] Calling method '.version_select at 0x7fdb068373a0>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:08.296629 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:43:08.371331 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-10fb33af-0501-4bb0-a9c4-6ca8bc4bfca6 tempest-VolumesTestJSON-1946084767 tempest-VolumesTestJSON-1946084767-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.089260 Jun 29 12:43:08.372013 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 435/892] 10.222.0.52 () {58 vars in 1154 bytes} [Wed Jun 29 12:43:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:43:08.383886 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-bf975fd5-f36e-4124-8654-195cd74bae50 tempest-VolumesTestJSON-1946084767 tempest-VolumesTestJSON-1946084767-project] Calling method '.version_select at 0x7fdb0682b040>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:08.471443 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-bf975fd5-f36e-4124-8654-195cd74bae50 tempest-VolumesTestJSON-1946084767 tempest-VolumesTestJSON-1946084767-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.092128 Jun 29 12:43:08.472016 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 458/893] 10.222.0.52 () {58 vars in 1187 bytes} [Wed Jun 29 12:43:08 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:43:08.483858 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b5918dc9-4c87-4341-a273-1b7ea2c7dba7 tempest-VolumesTestJSON-1946084767 tempest-VolumesTestJSON-1946084767-project] Calling method '.version_select at 0x7fdb068f8820>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:08.568255 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b5918dc9-4c87-4341-a273-1b7ea2c7dba7 tempest-VolumesTestJSON-1946084767 tempest-VolumesTestJSON-1946084767-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.088219 Jun 29 12:43:08.568835 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 436/894] 10.222.0.52 () {58 vars in 1154 bytes} [Wed Jun 29 12:43:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:43:09.135108 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-e9d84371-3f5d-4375-9baf-5807575ef9a1 req-8f1e4409-bb6b-4775-af8a-d41cd25bb021 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06d49d38-a3bd-4345-9cae-f02900b8ccb4", "tag": "c5c76edb-72c6-4d54-9ad3-cf7aec782a1f"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:43:09.143991 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-cbd2a37d-3a6d-449b-beef-9d50e7f68715 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:09.145234 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-e9d84371-3f5d-4375-9baf-5807575ef9a1 req-8f1e4409-bb6b-4775-af8a-d41cd25bb021 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:09.145387 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-cbd2a37d-3a6d-449b-beef-9d50e7f68715 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 06d49d38-a3bd-4345-9cae-f02900b8ccb4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:43:09.146261 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-e9d84371-3f5d-4375-9baf-5807575ef9a1 req-8f1e4409-bb6b-4775-af8a-d41cd25bb021 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:09.155270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cbd2a37d-3a6d-449b-beef-9d50e7f68715 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:09.155855 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cbd2a37d-3a6d-449b-beef-9d50e7f68715 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:09.156780 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cbd2a37d-3a6d-449b-beef-9d50e7f68715 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:09.157303 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cbd2a37d-3a6d-449b-beef-9d50e7f68715 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:09.159436 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-e9d84371-3f5d-4375-9baf-5807575ef9a1 req-8f1e4409-bb6b-4775-af8a-d41cd25bb021 service nova] Creating event network-changed:c5c76edb-72c6-4d54-9ad3-cf7aec782a1f for instance 06d49d38-a3bd-4345-9cae-f02900b8ccb4 on hv-cinder-81268 Jun 29 12:43:09.165963 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-e9d84371-3f5d-4375-9baf-5807575ef9a1 req-8f1e4409-bb6b-4775-af8a-d41cd25bb021 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035500 Jun 29 12:43:09.167020 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 459/895] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:43:09.373716 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-cbd2a37d-3a6d-449b-beef-9d50e7f68715 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:43:09.381167 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-cbd2a37d-3a6d-449b-beef-9d50e7f68715 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4" status: 200 len: 1319 microversion: 2.1 time: 0.243711 Jun 29 12:43:09.381730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 437/896] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:43:09 2022] GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:43:10.398394 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4feaad69-93e6-4e08-9826-99a2f8cfc535 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:10.399110 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4feaad69-93e6-4e08-9826-99a2f8cfc535 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 06d49d38-a3bd-4345-9cae-f02900b8ccb4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:43:10.405192 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4feaad69-93e6-4e08-9826-99a2f8cfc535 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:10.405630 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4feaad69-93e6-4e08-9826-99a2f8cfc535 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:10.406383 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4feaad69-93e6-4e08-9826-99a2f8cfc535 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:10.406838 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4feaad69-93e6-4e08-9826-99a2f8cfc535 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:10.537229 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4feaad69-93e6-4e08-9826-99a2f8cfc535 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:43:10.544896 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4feaad69-93e6-4e08-9826-99a2f8cfc535 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4" status: 200 len: 1319 microversion: 2.1 time: 0.151466 Jun 29 12:43:10.545456 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 460/897] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:43:10 2022] GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:43:11.561846 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-692ea731-3113-4063-849b-2f48d8e7b283 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:11.562469 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-692ea731-3113-4063-849b-2f48d8e7b283 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 06d49d38-a3bd-4345-9cae-f02900b8ccb4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:43:11.568816 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-692ea731-3113-4063-849b-2f48d8e7b283 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:11.569260 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-692ea731-3113-4063-849b-2f48d8e7b283 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:11.570038 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-692ea731-3113-4063-849b-2f48d8e7b283 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:11.570509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-692ea731-3113-4063-849b-2f48d8e7b283 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:11.699137 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-692ea731-3113-4063-849b-2f48d8e7b283 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:43:11.706372 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-692ea731-3113-4063-849b-2f48d8e7b283 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4" status: 200 len: 1319 microversion: 2.1 time: 0.148334 Jun 29 12:43:11.706957 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 438/898] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:43:11 2022] GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:43:12.723859 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b58a59e7-8c70-4f86-b042-c11972373662 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:12.724468 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b58a59e7-8c70-4f86-b042-c11972373662 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 06d49d38-a3bd-4345-9cae-f02900b8ccb4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:43:12.732212 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b58a59e7-8c70-4f86-b042-c11972373662 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:12.732662 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b58a59e7-8c70-4f86-b042-c11972373662 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:12.733426 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b58a59e7-8c70-4f86-b042-c11972373662 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:12.733918 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b58a59e7-8c70-4f86-b042-c11972373662 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:12.882631 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b58a59e7-8c70-4f86-b042-c11972373662 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:43:12.890649 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b58a59e7-8c70-4f86-b042-c11972373662 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4" status: 200 len: 1319 microversion: 2.1 time: 0.170371 Jun 29 12:43:12.891294 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 461/899] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:43:12 2022] GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:43:13.908797 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-94147288-d804-4f0f-9f26-858ac0b9f8a1 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:13.909413 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-94147288-d804-4f0f-9f26-858ac0b9f8a1 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 06d49d38-a3bd-4345-9cae-f02900b8ccb4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:43:13.917188 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-94147288-d804-4f0f-9f26-858ac0b9f8a1 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:13.917729 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-94147288-d804-4f0f-9f26-858ac0b9f8a1 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:13.918661 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-94147288-d804-4f0f-9f26-858ac0b9f8a1 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:13.919113 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-94147288-d804-4f0f-9f26-858ac0b9f8a1 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:14.048639 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-94147288-d804-4f0f-9f26-858ac0b9f8a1 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:43:14.056494 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-94147288-d804-4f0f-9f26-858ac0b9f8a1 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4" status: 200 len: 1319 microversion: 2.1 time: 0.151434 Jun 29 12:43:14.057052 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 439/900] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:43:13 2022] GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:43:14.466194 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-1029cada-d3f5-4899-a6db-6de26f81f625 req-35231e9a-552c-4dde-b423-5255fd804227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d49d38-a3bd-4345-9cae-f02900b8ccb4", "name": "network-vif-plugged", "status": "completed", "tag": "c5c76edb-72c6-4d54-9ad3-cf7aec782a1f"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:43:14.476182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-1029cada-d3f5-4899-a6db-6de26f81f625 req-35231e9a-552c-4dde-b423-5255fd804227 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:14.476706 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-1029cada-d3f5-4899-a6db-6de26f81f625 req-35231e9a-552c-4dde-b423-5255fd804227 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:14.487586 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-1029cada-d3f5-4899-a6db-6de26f81f625 req-35231e9a-552c-4dde-b423-5255fd804227 service nova] Creating event network-vif-plugged:c5c76edb-72c6-4d54-9ad3-cf7aec782a1f for instance 06d49d38-a3bd-4345-9cae-f02900b8ccb4 on hv-cinder-81268 Jun 29 12:43:14.492417 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-1029cada-d3f5-4899-a6db-6de26f81f625 req-35231e9a-552c-4dde-b423-5255fd804227 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029981 Jun 29 12:43:14.493162 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 462/901] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:43:15.074435 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6e00deeb-db11-4e0a-8f6a-9404e09e5a10 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:15.075069 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6e00deeb-db11-4e0a-8f6a-9404e09e5a10 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 06d49d38-a3bd-4345-9cae-f02900b8ccb4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:43:15.080991 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6e00deeb-db11-4e0a-8f6a-9404e09e5a10 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:15.081435 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6e00deeb-db11-4e0a-8f6a-9404e09e5a10 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:15.082185 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6e00deeb-db11-4e0a-8f6a-9404e09e5a10 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:15.082739 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6e00deeb-db11-4e0a-8f6a-9404e09e5a10 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:15.210941 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6e00deeb-db11-4e0a-8f6a-9404e09e5a10 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:43:15.218727 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6e00deeb-db11-4e0a-8f6a-9404e09e5a10 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4" status: 200 len: 1319 microversion: 2.1 time: 0.149237 Jun 29 12:43:15.219303 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 440/902] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:43:15 2022] GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:43:16.236443 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c100b2cb-a85e-41f0-b1b7-9b8d7bd77c46 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:16.237133 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c100b2cb-a85e-41f0-b1b7-9b8d7bd77c46 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 06d49d38-a3bd-4345-9cae-f02900b8ccb4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:43:16.245437 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c100b2cb-a85e-41f0-b1b7-9b8d7bd77c46 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:16.245878 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c100b2cb-a85e-41f0-b1b7-9b8d7bd77c46 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:16.246672 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c100b2cb-a85e-41f0-b1b7-9b8d7bd77c46 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:16.247102 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c100b2cb-a85e-41f0-b1b7-9b8d7bd77c46 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:16.385603 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c100b2cb-a85e-41f0-b1b7-9b8d7bd77c46 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:43:16.392989 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c100b2cb-a85e-41f0-b1b7-9b8d7bd77c46 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4" status: 200 len: 1508 microversion: 2.1 time: 0.161080 Jun 29 12:43:16.393542 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 463/903] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:43:16 2022] GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:43:16.409345 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b0fc0523-0f5a-4fd5-9ec9-470b495fa111 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a18245e-9d5f-4c98-9581-c89bc8a2a98d", "device": "/dev/sdb"}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:43:16.410511 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b0fc0523-0f5a-4fd5-9ec9-470b495fa111 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 06d49d38-a3bd-4345-9cae-f02900b8ccb4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:43:16.416996 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b0fc0523-0f5a-4fd5-9ec9-470b495fa111 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:16.417454 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b0fc0523-0f5a-4fd5-9ec9-470b495fa111 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:16.418214 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b0fc0523-0f5a-4fd5-9ec9-470b495fa111 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:16.418684 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b0fc0523-0f5a-4fd5-9ec9-470b495fa111 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:16.656443 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b0fc0523-0f5a-4fd5-9ec9-470b495fa111 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "POST /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250788 Jun 29 12:43:16.657366 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 441/904] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Jun 29 12:43:16 2022] POST /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:43:36.021836 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b0f41173-0a70-4b23-9ddc-b3d5cb7e6ea4 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:36.022328 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b0f41173-0a70-4b23-9ddc-b3d5cb7e6ea4 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 06d49d38-a3bd-4345-9cae-f02900b8ccb4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:43:36.024937 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:43:36.025675 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=6 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:43:36.026301 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:43:36.026959 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:43:36.033935 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b0f41173-0a70-4b23-9ddc-b3d5cb7e6ea4 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:36.034377 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b0f41173-0a70-4b23-9ddc-b3d5cb7e6ea4 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:36.035154 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b0f41173-0a70-4b23-9ddc-b3d5cb7e6ea4 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:36.035587 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b0f41173-0a70-4b23-9ddc-b3d5cb7e6ea4 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:36.237477 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-b0f41173-0a70-4b23-9ddc-b3d5cb7e6ea4 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lazy-loading 'services' on Instance uuid 06d49d38-a3bd-4345-9cae-f02900b8ccb4 {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 12:43:36.306590 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b0f41173-0a70-4b23-9ddc-b3d5cb7e6ea4 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "DELETE /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4/os-volume_attachments/7a18245e-9d5f-4c98-9581-c89bc8a2a98d" status: 202 len: 0 microversion: 2.1 time: 0.288828 Jun 29 12:43:36.307167 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 464/905] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 12:43:36 2022] DELETE /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4/os-volume_attachments/7a18245e-9d5f-4c98-9581-c89bc8a2a98d => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:43:37.429209 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e3f90eae-966b-44da-a1ab-a566a7323440 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:37.429745 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e3f90eae-966b-44da-a1ab-a566a7323440 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 06d49d38-a3bd-4345-9cae-f02900b8ccb4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:43:37.432735 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:43:37.433521 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:43:37.434236 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:43:37.441986 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e3f90eae-966b-44da-a1ab-a566a7323440 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:37.442526 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e3f90eae-966b-44da-a1ab-a566a7323440 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:37.443619 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e3f90eae-966b-44da-a1ab-a566a7323440 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:37.444440 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e3f90eae-966b-44da-a1ab-a566a7323440 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:37.472618 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e3f90eae-966b-44da-a1ab-a566a7323440 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 06d49d38-a3bd-4345-9cae-f02900b8ccb4] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 12:43:37.556744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e3f90eae-966b-44da-a1ab-a566a7323440 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "DELETE /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4" status: 204 len: 0 microversion: 2.1 time: 0.131467 Jun 29 12:43:37.557371 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 442/906] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:43:37 2022] DELETE /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 12:43:37.566753 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e17ef9a9-4b68-413e-a976-fde197fa0584 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:37.567454 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e17ef9a9-4b68-413e-a976-fde197fa0584 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 06d49d38-a3bd-4345-9cae-f02900b8ccb4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:43:37.574318 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e17ef9a9-4b68-413e-a976-fde197fa0584 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:37.574939 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e17ef9a9-4b68-413e-a976-fde197fa0584 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:37.575537 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e17ef9a9-4b68-413e-a976-fde197fa0584 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:37.576422 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e17ef9a9-4b68-413e-a976-fde197fa0584 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:37.706147 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e17ef9a9-4b68-413e-a976-fde197fa0584 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:43:37.714159 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e17ef9a9-4b68-413e-a976-fde197fa0584 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4" status: 200 len: 1514 microversion: 2.1 time: 0.152363 Jun 29 12:43:37.714751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 465/907] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:43:37 2022] GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:43:38.731852 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-76b83dc3-352c-4538-9a2f-e4c6b328fb0b tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:38.732465 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-76b83dc3-352c-4538-9a2f-e4c6b328fb0b tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 06d49d38-a3bd-4345-9cae-f02900b8ccb4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:43:38.738980 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-76b83dc3-352c-4538-9a2f-e4c6b328fb0b tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:38.739429 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-76b83dc3-352c-4538-9a2f-e4c6b328fb0b tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:38.740183 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-76b83dc3-352c-4538-9a2f-e4c6b328fb0b tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:38.740620 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-76b83dc3-352c-4538-9a2f-e4c6b328fb0b tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:38.977241 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-76b83dc3-352c-4538-9a2f-e4c6b328fb0b tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:43:38.985832 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-76b83dc3-352c-4538-9a2f-e4c6b328fb0b tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4" status: 200 len: 1514 microversion: 2.1 time: 0.257668 Jun 29 12:43:38.986780 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 443/908] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:43:38 2022] GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4 => generated 1514 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:43:40.004056 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f5d4cf67-f865-4b0e-8d03-bf135815a6da tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:40.004666 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f5d4cf67-f865-4b0e-8d03-bf135815a6da tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 06d49d38-a3bd-4345-9cae-f02900b8ccb4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:43:40.011696 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f5d4cf67-f865-4b0e-8d03-bf135815a6da tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:40.012140 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f5d4cf67-f865-4b0e-8d03-bf135815a6da tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:40.012889 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f5d4cf67-f865-4b0e-8d03-bf135815a6da tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:40.013323 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f5d4cf67-f865-4b0e-8d03-bf135815a6da tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:40.139796 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f5d4cf67-f865-4b0e-8d03-bf135815a6da tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:43:40.147410 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f5d4cf67-f865-4b0e-8d03-bf135815a6da tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4" status: 200 len: 1514 microversion: 2.1 time: 0.147178 Jun 29 12:43:40.147966 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 466/909] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:43:39 2022] GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:43:41.164638 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-016be1ed-0127-4ee0-a34c-6447f0d3fcd4 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:41.166255 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-016be1ed-0127-4ee0-a34c-6447f0d3fcd4 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 06d49d38-a3bd-4345-9cae-f02900b8ccb4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:43:41.172574 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-016be1ed-0127-4ee0-a34c-6447f0d3fcd4 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:41.173018 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-016be1ed-0127-4ee0-a34c-6447f0d3fcd4 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:41.173766 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-016be1ed-0127-4ee0-a34c-6447f0d3fcd4 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:41.174198 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-016be1ed-0127-4ee0-a34c-6447f0d3fcd4 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:41.299811 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-016be1ed-0127-4ee0-a34c-6447f0d3fcd4 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:43:41.307494 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-016be1ed-0127-4ee0-a34c-6447f0d3fcd4 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4" status: 200 len: 1514 microversion: 2.1 time: 0.146808 Jun 29 12:43:41.308046 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 444/910] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:43:41 2022] GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:43:42.324502 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-70919bb5-a9c7-44a3-92ae-f27b8637332b tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:42.325114 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-70919bb5-a9c7-44a3-92ae-f27b8637332b tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 06d49d38-a3bd-4345-9cae-f02900b8ccb4] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:43:42.331529 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-70919bb5-a9c7-44a3-92ae-f27b8637332b tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:42.331981 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-70919bb5-a9c7-44a3-92ae-f27b8637332b tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:42.332744 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-70919bb5-a9c7-44a3-92ae-f27b8637332b tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:42.333183 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-70919bb5-a9c7-44a3-92ae-f27b8637332b tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:42.463928 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-70919bb5-a9c7-44a3-92ae-f27b8637332b tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:43:42.471310 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-70919bb5-a9c7-44a3-92ae-f27b8637332b tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4" status: 200 len: 1514 microversion: 2.1 time: 0.150681 Jun 29 12:43:42.471871 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 467/911] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:43:42 2022] GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:43:43.489144 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-bf6f3141-b6c9-46cd-b305-7b4324191eca tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:43.489711 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-bf6f3141-b6c9-46cd-b305-7b4324191eca tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 06d49d38-a3bd-4345-9cae-f02900b8ccb4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:43:43.496513 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bf6f3141-b6c9-46cd-b305-7b4324191eca tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:43.496960 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bf6f3141-b6c9-46cd-b305-7b4324191eca tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:43.497718 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bf6f3141-b6c9-46cd-b305-7b4324191eca tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:43.498161 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bf6f3141-b6c9-46cd-b305-7b4324191eca tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:43.993716 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-91ce4dfa-5047-442c-8cae-6a45dcedae9d req-2b291cbe-a96b-49f4-b4fb-9673f89f42e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d49d38-a3bd-4345-9cae-f02900b8ccb4", "name": "network-vif-deleted", "tag": "c5c76edb-72c6-4d54-9ad3-cf7aec782a1f"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:43:44.005383 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-bf6f3141-b6c9-46cd-b305-7b4324191eca tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb9bae5e3522437182d2650c3fcfdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ba9e59fe574391a0c8342daed01416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:43:44.008231 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-91ce4dfa-5047-442c-8cae-6a45dcedae9d req-2b291cbe-a96b-49f4-b4fb-9673f89f42e7 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:44.008940 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-91ce4dfa-5047-442c-8cae-6a45dcedae9d req-2b291cbe-a96b-49f4-b4fb-9673f89f42e7 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:44.020906 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-91ce4dfa-5047-442c-8cae-6a45dcedae9d req-2b291cbe-a96b-49f4-b4fb-9673f89f42e7 service nova] Creating event network-vif-deleted:c5c76edb-72c6-4d54-9ad3-cf7aec782a1f for instance 06d49d38-a3bd-4345-9cae-f02900b8ccb4 on hv-cinder-81268 Jun 29 12:43:44.027897 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-bf6f3141-b6c9-46cd-b305-7b4324191eca tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4" status: 200 len: 1514 microversion: 2.1 time: 0.542690 Jun 29 12:43:44.028564 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 445/912] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:43:43 2022] GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4 => generated 1514 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:43:44.028978 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-91ce4dfa-5047-442c-8cae-6a45dcedae9d req-2b291cbe-a96b-49f4-b4fb-9673f89f42e7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038443 Jun 29 12:43:44.029948 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 468/913] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:43:45.047291 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-361330ef-f713-4b43-a5f4-ad5585448864 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:43:45.047948 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-361330ef-f713-4b43-a5f4-ad5585448864 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] [instance: 06d49d38-a3bd-4345-9cae-f02900b8ccb4] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:43:45.054287 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-361330ef-f713-4b43-a5f4-ad5585448864 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:45.054769 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-361330ef-f713-4b43-a5f4-ad5585448864 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:45.056374 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-361330ef-f713-4b43-a5f4-ad5585448864 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:43:45.056837 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-361330ef-f713-4b43-a5f4-ad5585448864 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:43:45.069703 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-361330ef-f713-4b43-a5f4-ad5585448864 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] HTTP exception thrown: Instance 06d49d38-a3bd-4345-9cae-f02900b8ccb4 could not be found. Jun 29 12:43:45.071567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-361330ef-f713-4b43-a5f4-ad5585448864 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Request method failure captured: Jun 29 12:43:45.071567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: request: GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4 HTTP/1.1 Jun 29 12:43:45.071567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept: application/json Jun 29 12:43:45.071567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jun 29 12:43:45.071567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Connection: close Jun 29 12:43:45.071567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jun 29 12:43:45.071567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jun 29 12:43:45.071567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Host: 10.222.0.52 Jun 29 12:43:45.071567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jun 29 12:43:45.071567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jun 29 12:43:45.071567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivEiewQy9TttkKxsYHeD6KJMAHlidh8TtskpUir_TWGpKeapFRAabmklXxVbtrLzGEDZOHZzBp4PKYNdYkxK2EtP7WN4kDK9d-GC6ftWvHd3aGAnXrPv8lNSPcm74ANvdRvq6V0CQkFBflThd1HnRg_Op65gZwWnViK4RLlj4xNDuK8k Jun 29 12:43:45.071567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jun 29 12:43:45.071567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jun 29 12:43:45.071567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jun 29 12:43:45.071567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jun 29 12:43:45.071567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jun 29 12:43:45.071567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jun 29 12:43:45.071567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Id: e1ba9e59fe574391a0c8342daed01416 Jun 29 12:43:45.071567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-VolumesSnapshotTestJSON-353834511 Jun 29 12:43:45.071567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jun 29 12:43:45.071567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jun 29 12:43:45.073270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e1ba9e59fe574391a0c8342daed01416", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e1ba9e59fe574391a0c8342daed01416"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e1ba9e59fe574391a0c8342daed01416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e1ba9e59fe574391a0c8342daed01416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:43:45.073270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-VolumesSnapshotTestJSON-353834511 Jun 29 12:43:45.073270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Id: e1ba9e59fe574391a0c8342daed01416 Jun 29 12:43:45.073270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-353834511 Jun 29 12:43:45.073270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User: tempest-VolumesSnapshotTestJSON-353834511-project Jun 29 12:43:45.073270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jun 29 12:43:45.073270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jun 29 12:43:45.073270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Id: eb9bae5e3522437182d2650c3fcfdef6 Jun 29 12:43:45.073270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-VolumesSnapshotTestJSON-353834511-project Jun 29 12:43:45.073270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: method: > Jun 29 12:43:45.073270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: exception: Instance 06d49d38-a3bd-4345-9cae-f02900b8ccb4 could not be found. Jun 29 12:43:45.073270 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: action_args: {'id': '06d49d38-a3bd-4345-9cae-f02900b8ccb4'} Jun 29 12:43:45.074178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:43:45.074178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:43:45.074178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:43:45.074178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:43:45.074178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:43:45.074178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:43:45.074178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:43:45.074178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:43:45.074178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:43:45.074178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:43:45.074178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06d49d38-a3bd-4345-9cae-f02900b8ccb4 could not be found. Jun 29 12:43:45.074178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:43:45.074178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:43:45.074178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:43:45.074178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:43:45.074178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:43:45.074178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:43:45.074178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:43:45.074178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:43:45.074178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:43:45.075820 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:43:45.075820 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:43:45.075820 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:43:45.075820 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:43:45.075820 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:43:45.075820 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:43:45.075820 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:43:45.075820 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06d49d38-a3bd-4345-9cae-f02900b8ccb4 could not be found. Jun 29 12:43:45.075820 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:43:45.075820 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:43:45.075820 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:43:45.075820 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:43:45.075820 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:43:45.075820 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:43:45.075820 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:43:45.075820 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:43:45.075820 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06d49d38-a3bd-4345-9cae-f02900b8ccb4 could not be found. Jun 29 12:43:45.075820 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:43:45.077385 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-361330ef-f713-4b43-a5f4-ad5585448864 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] Returning 404 to user: Instance 06d49d38-a3bd-4345-9cae-f02900b8ccb4 could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:43:45.077385 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-361330ef-f713-4b43-a5f4-ad5585448864 tempest-VolumesSnapshotTestJSON-353834511 tempest-VolumesSnapshotTestJSON-353834511-project] 10.222.0.52 "GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4" status: 404 len: 111 microversion: 2.1 time: 0.029509 Jun 29 12:43:45.077385 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 446/914] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:43:45 2022] GET /compute/v2.1/servers/06d49d38-a3bd-4345-9cae-f02900b8ccb4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:44:25.957802 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=10 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:44:25.958946 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:44:25.963125 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-42df82ab-0e31-40f8-a2fd-b669db89355c tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Action: 'create', calling method: .version_select at 0x7fdb06903d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1192223444", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7oNGIyIuL7BISiBgRxAqJAJnb/fqmqJe9c/KosoMu/5srn8c5b3egoek8kn+VUNl0TmrbeLmlCEec6M0VBzi5Mb/p8Yy1f3qZCPPJBKBSQnEM5/itLjuFE8E7zzhozcQ=="}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:44:25.978984 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-42df82ab-0e31-40f8-a2fd-b669db89355c tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Getting quotas for project 925a9005d7494b04923bdaa194731362. Resources: {'key_pairs'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:44:25.982813 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-42df82ab-0e31-40f8-a2fd-b669db89355c tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Getting quotas for user fd70c574b180445f9348d9aee8ac4c82 and project 925a9005d7494b04923bdaa194731362. Resources: {'key_pairs'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:44:26.003639 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-42df82ab-0e31-40f8-a2fd-b669db89355c tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.047361 Jun 29 12:44:26.004212 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 469/915] 10.222.0.52 () {60 vars in 1158 bytes} [Wed Jun 29 12:44:25 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:44:26.052036 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-00978ca9-277c-4cac-b7d0-02319ca6288e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-276033181", "imageRef": "474ff379-5a7e-4421-bf0c-6899702d2f52", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1192223444", "networks": [{"uuid": "77c64380-9fbd-44ac-bf31-c748526ddf4a"}]}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:44:26.059208 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:44:26.059859 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:44:26.104482 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.network.neutron [None req-00978ca9-277c-4cac-b7d0-02319ca6288e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] validate_networks() for [('77c64380-9fbd-44ac-bf31-c748526ddf4a', None, None, None, None, None)] {{(pid=124316) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 12:44:26.478241 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-00978ca9-277c-4cac-b7d0-02319ca6288e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Flavor limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 12:44:26.478706 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-00978ca9-277c-4cac-b7d0-02319ca6288e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Image limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 12:44:26.479181 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-00978ca9-277c-4cac-b7d0-02319ca6288e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Flavor pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 12:44:26.479595 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-00978ca9-277c-4cac-b7d0-02319ca6288e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Image pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 12:44:26.480034 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-00978ca9-277c-4cac-b7d0-02319ca6288e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 12:44:26.489346 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-00978ca9-277c-4cac-b7d0-02319ca6288e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:26.489793 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-00978ca9-277c-4cac-b7d0-02319ca6288e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:26.490624 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-00978ca9-277c-4cac-b7d0-02319ca6288e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:26.491064 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-00978ca9-277c-4cac-b7d0-02319ca6288e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:26.509160 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-00978ca9-277c-4cac-b7d0-02319ca6288e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Getting quotas for project 925a9005d7494b04923bdaa194731362. Resources: {'cores', 'ram', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:44:26.514220 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-00978ca9-277c-4cac-b7d0-02319ca6288e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Getting quotas for user fd70c574b180445f9348d9aee8ac4c82 and project 925a9005d7494b04923bdaa194731362. Resources: {'cores', 'ram', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:44:26.525166 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-00978ca9-277c-4cac-b7d0-02319ca6288e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Going to run 1 instances... {{(pid=124316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 12:44:26.527892 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-00978ca9-277c-4cac-b7d0-02319ca6288e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='474ff379-5a7e-4421-bf0c-6899702d2f52',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 12:44:26.576393 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-00978ca9-277c-4cac-b7d0-02319ca6288e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528107 Jun 29 12:44:26.577027 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 447/916] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 12:44:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 12:44:26.586904 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b79dcaa7-3c7b-4180-9973-baf3150c830c tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:44:26.587641 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b79dcaa7-3c7b-4180-9973-baf3150c830c tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:44:26.641750 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b79dcaa7-3c7b-4180-9973-baf3150c830c tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:44:26.648608 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b79dcaa7-3c7b-4180-9973-baf3150c830c tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1258 microversion: 2.1 time: 0.065523 Jun 29 12:44:26.649181 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 470/917] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:44:26 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:44:27.665739 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e6fb0cd2-d0b8-4e19-bd76-e011938a6e46 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:44:27.666348 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e6fb0cd2-d0b8-4e19-bd76-e011938a6e46 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:44:27.673078 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e6fb0cd2-d0b8-4e19-bd76-e011938a6e46 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:27.673525 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e6fb0cd2-d0b8-4e19-bd76-e011938a6e46 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:27.674282 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e6fb0cd2-d0b8-4e19-bd76-e011938a6e46 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:27.674744 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e6fb0cd2-d0b8-4e19-bd76-e011938a6e46 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:27.739463 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e6fb0cd2-d0b8-4e19-bd76-e011938a6e46 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:44:27.747022 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e6fb0cd2-d0b8-4e19-bd76-e011938a6e46 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1254 microversion: 2.1 time: 0.085782 Jun 29 12:44:27.747588 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 448/918] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:44:27 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1254 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:44:28.765321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3d7e11be-0a31-4418-a4f0-5d2dcc52a0ca tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:44:28.766116 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3d7e11be-0a31-4418-a4f0-5d2dcc52a0ca tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:44:28.800053 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3d7e11be-0a31-4418-a4f0-5d2dcc52a0ca tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:28.800400 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3d7e11be-0a31-4418-a4f0-5d2dcc52a0ca tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:28.801252 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3d7e11be-0a31-4418-a4f0-5d2dcc52a0ca tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:28.801702 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3d7e11be-0a31-4418-a4f0-5d2dcc52a0ca tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:29.019700 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3d7e11be-0a31-4418-a4f0-5d2dcc52a0ca tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:44:29.043699 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3d7e11be-0a31-4418-a4f0-5d2dcc52a0ca tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1358 microversion: 2.1 time: 0.282668 Jun 29 12:44:29.053286 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 471/919] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:44:28 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1358 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:44:30.061256 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4d884045-c51f-435e-8b6a-62e9c967f826 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:44:30.061872 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4d884045-c51f-435e-8b6a-62e9c967f826 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:44:30.068295 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4d884045-c51f-435e-8b6a-62e9c967f826 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:30.068743 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4d884045-c51f-435e-8b6a-62e9c967f826 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:30.069503 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4d884045-c51f-435e-8b6a-62e9c967f826 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:30.070045 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4d884045-c51f-435e-8b6a-62e9c967f826 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:30.213483 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4d884045-c51f-435e-8b6a-62e9c967f826 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:44:30.221987 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4d884045-c51f-435e-8b6a-62e9c967f826 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1358 microversion: 2.1 time: 0.165012 Jun 29 12:44:30.223351 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 449/920] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:44:30 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:44:31.240614 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6e4f673a-1a69-446f-a9fd-7fad80cbc2e1 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:44:31.241346 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-6e4f673a-1a69-446f-a9fd-7fad80cbc2e1 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:44:31.247956 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6e4f673a-1a69-446f-a9fd-7fad80cbc2e1 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:31.248404 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6e4f673a-1a69-446f-a9fd-7fad80cbc2e1 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:31.249164 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6e4f673a-1a69-446f-a9fd-7fad80cbc2e1 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:31.249594 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6e4f673a-1a69-446f-a9fd-7fad80cbc2e1 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:31.386710 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6e4f673a-1a69-446f-a9fd-7fad80cbc2e1 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:44:31.394683 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6e4f673a-1a69-446f-a9fd-7fad80cbc2e1 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1358 microversion: 2.1 time: 0.157776 Jun 29 12:44:31.395267 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 472/921] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:44:31 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:44:32.412918 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ac6acda5-73f0-49fe-b383-1a15705c8f78 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:44:32.413549 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ac6acda5-73f0-49fe-b383-1a15705c8f78 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:44:32.420236 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ac6acda5-73f0-49fe-b383-1a15705c8f78 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:32.420670 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ac6acda5-73f0-49fe-b383-1a15705c8f78 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:32.421439 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ac6acda5-73f0-49fe-b383-1a15705c8f78 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:32.421871 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ac6acda5-73f0-49fe-b383-1a15705c8f78 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:32.559830 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ac6acda5-73f0-49fe-b383-1a15705c8f78 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:44:32.567898 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ac6acda5-73f0-49fe-b383-1a15705c8f78 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1358 microversion: 2.1 time: 0.158814 Jun 29 12:44:32.568467 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 450/922] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:44:32 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:44:33.585778 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6b5bd9d6-bd62-4145-90d7-c54761936a8d tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:44:33.587705 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-6b5bd9d6-bd62-4145-90d7-c54761936a8d tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:44:33.595437 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6b5bd9d6-bd62-4145-90d7-c54761936a8d tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:33.596511 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6b5bd9d6-bd62-4145-90d7-c54761936a8d tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:33.597565 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6b5bd9d6-bd62-4145-90d7-c54761936a8d tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:33.598340 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6b5bd9d6-bd62-4145-90d7-c54761936a8d tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:33.735535 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6b5bd9d6-bd62-4145-90d7-c54761936a8d tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:44:33.742780 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6b5bd9d6-bd62-4145-90d7-c54761936a8d tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1358 microversion: 2.1 time: 0.161544 Jun 29 12:44:33.743336 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 473/923] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:44:33 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:44:34.759984 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e2ad4a6a-0fa7-4534-a4d5-406dc4f8cb21 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:44:34.760924 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e2ad4a6a-0fa7-4534-a4d5-406dc4f8cb21 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:44:34.768818 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e2ad4a6a-0fa7-4534-a4d5-406dc4f8cb21 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:34.769737 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e2ad4a6a-0fa7-4534-a4d5-406dc4f8cb21 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:34.770977 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e2ad4a6a-0fa7-4534-a4d5-406dc4f8cb21 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:34.771966 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e2ad4a6a-0fa7-4534-a4d5-406dc4f8cb21 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:34.912733 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e2ad4a6a-0fa7-4534-a4d5-406dc4f8cb21 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:44:34.920949 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e2ad4a6a-0fa7-4534-a4d5-406dc4f8cb21 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1358 microversion: 2.1 time: 0.164866 Jun 29 12:44:34.921504 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 451/924] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:44:34 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:44:35.938227 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-23cd32d4-db5e-40aa-a874-03e2c93dbdf0 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:44:35.938891 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-23cd32d4-db5e-40aa-a874-03e2c93dbdf0 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:44:35.945866 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-23cd32d4-db5e-40aa-a874-03e2c93dbdf0 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:35.945985 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-23cd32d4-db5e-40aa-a874-03e2c93dbdf0 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:35.946777 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-23cd32d4-db5e-40aa-a874-03e2c93dbdf0 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:35.947217 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-23cd32d4-db5e-40aa-a874-03e2c93dbdf0 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:36.082054 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-23cd32d4-db5e-40aa-a874-03e2c93dbdf0 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:44:36.089965 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-23cd32d4-db5e-40aa-a874-03e2c93dbdf0 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1358 microversion: 2.1 time: 0.155149 Jun 29 12:44:36.090667 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 474/925] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:44:35 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:44:37.109375 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-bd479568-7326-431f-bb8a-77b01f10ba9c tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:44:37.110558 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-bd479568-7326-431f-bb8a-77b01f10ba9c tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:44:37.112839 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:44:37.113988 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=6 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:44:37.119404 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bd479568-7326-431f-bb8a-77b01f10ba9c tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:37.119858 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bd479568-7326-431f-bb8a-77b01f10ba9c tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:37.120709 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bd479568-7326-431f-bb8a-77b01f10ba9c tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:37.121242 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-bd479568-7326-431f-bb8a-77b01f10ba9c tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:37.159674 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=6 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:44:37.312026 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-55a6e9e4-6a8a-44d6-a0b7-8fd648910394 req-367e404d-1361-470f-b61f-d8cf8202bd6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb26ced2-9107-42de-bf41-f626a3a59489", "tag": "791b6e53-c814-4742-81f0-e3cfd45597e8"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:44:37.320562 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-55a6e9e4-6a8a-44d6-a0b7-8fd648910394 req-367e404d-1361-470f-b61f-d8cf8202bd6c service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:37.321012 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-55a6e9e4-6a8a-44d6-a0b7-8fd648910394 req-367e404d-1361-470f-b61f-d8cf8202bd6c service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:37.333163 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-55a6e9e4-6a8a-44d6-a0b7-8fd648910394 req-367e404d-1361-470f-b61f-d8cf8202bd6c service nova] Creating event network-changed:791b6e53-c814-4742-81f0-e3cfd45597e8 for instance eb26ced2-9107-42de-bf41-f626a3a59489 on hv-cinder-81268 Jun 29 12:44:37.338521 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-55a6e9e4-6a8a-44d6-a0b7-8fd648910394 req-367e404d-1361-470f-b61f-d8cf8202bd6c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183015 Jun 29 12:44:37.338936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 475/926] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:44:37.406760 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-bd479568-7326-431f-bb8a-77b01f10ba9c tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:44:37.414036 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-bd479568-7326-431f-bb8a-77b01f10ba9c tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1358 microversion: 2.1 time: 0.308851 Jun 29 12:44:37.414850 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 452/927] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:44:37 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1358 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:44:38.433210 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-87e36961-b338-4d8c-a589-f8b452145757 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:44:38.434041 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-87e36961-b338-4d8c-a589-f8b452145757 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:44:38.440392 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-87e36961-b338-4d8c-a589-f8b452145757 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:38.440916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-87e36961-b338-4d8c-a589-f8b452145757 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:38.441755 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-87e36961-b338-4d8c-a589-f8b452145757 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:38.442205 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-87e36961-b338-4d8c-a589-f8b452145757 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:38.580671 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-87e36961-b338-4d8c-a589-f8b452145757 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:44:38.587939 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-87e36961-b338-4d8c-a589-f8b452145757 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1358 microversion: 2.1 time: 0.159548 Jun 29 12:44:38.594513 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 476/928] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:44:38 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:44:39.605569 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fcd480d2-7b6e-48b7-92e7-598115f7527a tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:44:39.606200 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-fcd480d2-7b6e-48b7-92e7-598115f7527a tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:44:39.613057 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fcd480d2-7b6e-48b7-92e7-598115f7527a tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:39.613563 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fcd480d2-7b6e-48b7-92e7-598115f7527a tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:39.614367 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fcd480d2-7b6e-48b7-92e7-598115f7527a tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:39.614786 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fcd480d2-7b6e-48b7-92e7-598115f7527a tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:39.741580 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-fcd480d2-7b6e-48b7-92e7-598115f7527a tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:44:39.750061 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-fcd480d2-7b6e-48b7-92e7-598115f7527a tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1358 microversion: 2.1 time: 0.148858 Jun 29 12:44:39.750646 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 453/929] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:44:39 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:44:40.769841 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8d579cb8-1b34-4d22-9472-391e864c2c91 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:44:40.770455 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8d579cb8-1b34-4d22-9472-391e864c2c91 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:44:40.777197 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8d579cb8-1b34-4d22-9472-391e864c2c91 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:40.777634 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8d579cb8-1b34-4d22-9472-391e864c2c91 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:40.778452 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8d579cb8-1b34-4d22-9472-391e864c2c91 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:40.779156 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8d579cb8-1b34-4d22-9472-391e864c2c91 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:40.909194 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8d579cb8-1b34-4d22-9472-391e864c2c91 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:44:40.916659 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8d579cb8-1b34-4d22-9472-391e864c2c91 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1358 microversion: 2.1 time: 0.151846 Jun 29 12:44:40.917225 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 477/930] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:44:40 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:44:41.933904 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6cf8f6f3-24bb-4a24-8532-b39b1695939f tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:44:41.935188 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6cf8f6f3-24bb-4a24-8532-b39b1695939f tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:44:41.941693 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6cf8f6f3-24bb-4a24-8532-b39b1695939f tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:41.942150 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6cf8f6f3-24bb-4a24-8532-b39b1695939f tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:41.942943 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6cf8f6f3-24bb-4a24-8532-b39b1695939f tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:41.943386 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6cf8f6f3-24bb-4a24-8532-b39b1695939f tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:42.071877 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6cf8f6f3-24bb-4a24-8532-b39b1695939f tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:44:42.079417 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6cf8f6f3-24bb-4a24-8532-b39b1695939f tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1358 microversion: 2.1 time: 0.149382 Jun 29 12:44:42.079976 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 454/931] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:44:41 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:44:42.948704 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-c38241ca-e195-4395-82b8-a57eecf9c69d req-18744507-dab6-475f-be2d-db35b9f4319d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb26ced2-9107-42de-bf41-f626a3a59489", "name": "network-vif-plugged", "status": "completed", "tag": "791b6e53-c814-4742-81f0-e3cfd45597e8"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:44:42.957474 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-c38241ca-e195-4395-82b8-a57eecf9c69d req-18744507-dab6-475f-be2d-db35b9f4319d service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:42.957915 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-c38241ca-e195-4395-82b8-a57eecf9c69d req-18744507-dab6-475f-be2d-db35b9f4319d service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:42.968745 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-c38241ca-e195-4395-82b8-a57eecf9c69d req-18744507-dab6-475f-be2d-db35b9f4319d service nova] Creating event network-vif-plugged:791b6e53-c814-4742-81f0-e3cfd45597e8 for instance eb26ced2-9107-42de-bf41-f626a3a59489 on hv-cinder-81268 Jun 29 12:44:42.973607 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-c38241ca-e195-4395-82b8-a57eecf9c69d req-18744507-dab6-475f-be2d-db35b9f4319d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086942 Jun 29 12:44:42.974182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 478/932] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:44:43.096264 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4ae8fbad-6d85-437e-83be-06cf61158942 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:44:43.096881 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4ae8fbad-6d85-437e-83be-06cf61158942 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:44:43.103628 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4ae8fbad-6d85-437e-83be-06cf61158942 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:43.104076 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4ae8fbad-6d85-437e-83be-06cf61158942 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:43.104841 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4ae8fbad-6d85-437e-83be-06cf61158942 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:43.105275 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4ae8fbad-6d85-437e-83be-06cf61158942 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:43.271157 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4ae8fbad-6d85-437e-83be-06cf61158942 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:44:43.279557 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4ae8fbad-6d85-437e-83be-06cf61158942 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1358 microversion: 2.1 time: 0.187086 Jun 29 12:44:43.280165 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 455/933] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:44:43 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:44:44.297341 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0afade24-3896-46f8-80dc-8c7dc1eddcfe tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:44:44.298072 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0afade24-3896-46f8-80dc-8c7dc1eddcfe tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:44:44.304337 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0afade24-3896-46f8-80dc-8c7dc1eddcfe tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:44.304791 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0afade24-3896-46f8-80dc-8c7dc1eddcfe tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:44.305547 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0afade24-3896-46f8-80dc-8c7dc1eddcfe tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:44.305987 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0afade24-3896-46f8-80dc-8c7dc1eddcfe tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:44.436709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0afade24-3896-46f8-80dc-8c7dc1eddcfe tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:44:44.444299 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0afade24-3896-46f8-80dc-8c7dc1eddcfe tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1548 microversion: 2.1 time: 0.151620 Jun 29 12:44:44.444867 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 479/934] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:44:44 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:44:44.461320 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ee6742f2-5fc7-4b61-b70a-c183abdce332 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:44:44.461928 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ee6742f2-5fc7-4b61-b70a-c183abdce332 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:44:44.468950 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ee6742f2-5fc7-4b61-b70a-c183abdce332 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:44.469405 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ee6742f2-5fc7-4b61-b70a-c183abdce332 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:44.470179 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ee6742f2-5fc7-4b61-b70a-c183abdce332 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:44.470649 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ee6742f2-5fc7-4b61-b70a-c183abdce332 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:44.611265 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ee6742f2-5fc7-4b61-b70a-c183abdce332 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:44:44.618939 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ee6742f2-5fc7-4b61-b70a-c183abdce332 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1548 microversion: 2.1 time: 0.161344 Jun 29 12:44:44.619509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 456/935] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:44:44 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:44:44.635243 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-9bb98cf2-9a4a-455f-8390-28fd3e8cf987 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:44:44.638718 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-9bb98cf2-9a4a-455f-8390-28fd3e8cf987 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:44:44.639472 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-9bb98cf2-9a4a-455f-8390-28fd3e8cf987 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Searching by: {'deleted': False, 'project_id': '925a9005d7494b04923bdaa194731362'} {{(pid=124317) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 29 12:44:44.645982 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9bb98cf2-9a4a-455f-8390-28fd3e8cf987 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:44.646475 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9bb98cf2-9a4a-455f-8390-28fd3e8cf987 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:44.647515 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9bb98cf2-9a4a-455f-8390-28fd3e8cf987 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:44.647944 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-9bb98cf2-9a4a-455f-8390-28fd3e8cf987 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:44.887949 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.multi_cell_list [None req-9bb98cf2-9a4a-455f-8390-28fd3e8cf987 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124317) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 29 12:44:44.979171 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-9bb98cf2-9a4a-455f-8390-28fd3e8cf987 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.347582 Jun 29 12:44:44.979750 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 480/936] 10.222.0.52 () {58 vars in 1124 bytes} [Wed Jun 29 12:44:44 2022] GET /compute/v2.1/servers => generated 342 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:44:44.990405 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fc2f9dcd-a05e-4d92-8825-5994665a50fc tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:44:44.991130 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-fc2f9dcd-a05e-4d92-8825-5994665a50fc tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:44:44.997166 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fc2f9dcd-a05e-4d92-8825-5994665a50fc tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:44.997614 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fc2f9dcd-a05e-4d92-8825-5994665a50fc tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:44.998393 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fc2f9dcd-a05e-4d92-8825-5994665a50fc tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:44.998850 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fc2f9dcd-a05e-4d92-8825-5994665a50fc tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:45.126975 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-fc2f9dcd-a05e-4d92-8825-5994665a50fc tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:44:45.134305 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-fc2f9dcd-a05e-4d92-8825-5994665a50fc tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1548 microversion: 2.1 time: 0.147759 Jun 29 12:44:45.134882 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 457/937] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:44:44 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:44:46.649796 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-006fe4ef-a040-4286-9b45-6b776df6eeba tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b049cd85-1824-47ed-9e4e-c48e84230581"}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:44:46.650895 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-006fe4ef-a040-4286-9b45-6b776df6eeba tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:44:46.657829 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-006fe4ef-a040-4286-9b45-6b776df6eeba tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:46.658280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-006fe4ef-a040-4286-9b45-6b776df6eeba tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:46.659095 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-006fe4ef-a040-4286-9b45-6b776df6eeba tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:46.659531 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-006fe4ef-a040-4286-9b45-6b776df6eeba tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:46.894199 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-006fe4ef-a040-4286-9b45-6b776df6eeba tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "POST /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248450 Jun 29 12:44:46.894852 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 481/938] 10.222.0.52 () {60 vars in 1322 bytes} [Wed Jun 29 12:44:46 2022] POST /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:44:53.377484 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4dd826ba-83f0-4d8d-a701-3574c86a003e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:44:53.378114 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4dd826ba-83f0-4d8d-a701-3574c86a003e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:44:53.384329 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4dd826ba-83f0-4d8d-a701-3574c86a003e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:53.384773 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4dd826ba-83f0-4d8d-a701-3574c86a003e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:53.385520 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4dd826ba-83f0-4d8d-a701-3574c86a003e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:53.385952 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4dd826ba-83f0-4d8d-a701-3574c86a003e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:53.511497 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4dd826ba-83f0-4d8d-a701-3574c86a003e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:44:53.519533 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4dd826ba-83f0-4d8d-a701-3574c86a003e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1594 microversion: 2.1 time: 0.146894 Jun 29 12:44:53.520096 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 458/939] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:44:53 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1594 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:44:55.105603 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:44:55.174565 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-af9ec15e-63c0-4d97-a41a-38600eced08b req-6852e900-ce1d-4e17-be92-24939da41141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb26ced2-9107-42de-bf41-f626a3a59489", "tag": "791b6e53-c814-4742-81f0-e3cfd45597e8"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:44:55.183654 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-af9ec15e-63c0-4d97-a41a-38600eced08b req-6852e900-ce1d-4e17-be92-24939da41141 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:55.184271 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-af9ec15e-63c0-4d97-a41a-38600eced08b req-6852e900-ce1d-4e17-be92-24939da41141 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:55.197409 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-af9ec15e-63c0-4d97-a41a-38600eced08b req-6852e900-ce1d-4e17-be92-24939da41141 service nova] Creating event network-changed:791b6e53-c814-4742-81f0-e3cfd45597e8 for instance eb26ced2-9107-42de-bf41-f626a3a59489 on hv-cinder-81268 Jun 29 12:44:55.202729 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-af9ec15e-63c0-4d97-a41a-38600eced08b req-6852e900-ce1d-4e17-be92-24939da41141 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098586 Jun 29 12:44:55.203838 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 482/940] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:44:56.089394 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9ed46d3b-0ec0-412f-93e7-5d4fba2b43c3 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1571066103"}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:44:56.089923 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-9ed46d3b-0ec0-412f-93e7-5d4fba2b43c3 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:44:56.092373 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:44:56.098636 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9ed46d3b-0ec0-412f-93e7-5d4fba2b43c3 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:56.099090 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9ed46d3b-0ec0-412f-93e7-5d4fba2b43c3 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:56.099863 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9ed46d3b-0ec0-412f-93e7-5d4fba2b43c3 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:56.100492 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9ed46d3b-0ec0-412f-93e7-5d4fba2b43c3 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:56.105040 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=69 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:44:56.241748 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.network.security_group_api [None req-9ed46d3b-0ec0-412f-93e7-5d4fba2b43c3 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Adding security group 0c7d11df-14d9-46c8-8844-854b574565ac to port 791b6e53-c814-4742-81f0-e3cfd45597e8 Jun 29 12:44:56.591118 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9ed46d3b-0ec0-412f-93e7-5d4fba2b43c3 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "POST /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489/action" status: 202 len: 0 microversion: 2.1 time: 0.505591 Jun 29 12:44:56.591860 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 459/941] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 12:44:56 2022] POST /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:44:56.606896 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-d3e344c6-7ff1-4b03-bf09-ad003069ffb4 req-54abb8b7-f6d5-4303-bf8c-98cf33ba3564 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb26ced2-9107-42de-bf41-f626a3a59489", "tag": "791b6e53-c814-4742-81f0-e3cfd45597e8"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:44:56.607882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-70fdb4e5-928f-4a32-8a7b-9f7d69beb982 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:44:56.611541 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-70fdb4e5-928f-4a32-8a7b-9f7d69beb982 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:44:56.614058 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:44:56.634366 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-d3e344c6-7ff1-4b03-bf09-ad003069ffb4 req-54abb8b7-f6d5-4303-bf8c-98cf33ba3564 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:56.634858 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-d3e344c6-7ff1-4b03-bf09-ad003069ffb4 req-54abb8b7-f6d5-4303-bf8c-98cf33ba3564 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:56.643757 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-70fdb4e5-928f-4a32-8a7b-9f7d69beb982 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:56.644349 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-70fdb4e5-928f-4a32-8a7b-9f7d69beb982 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:56.645706 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-70fdb4e5-928f-4a32-8a7b-9f7d69beb982 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:44:56.646154 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-70fdb4e5-928f-4a32-8a7b-9f7d69beb982 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:44:56.657777 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:44:56.661081 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-d3e344c6-7ff1-4b03-bf09-ad003069ffb4 req-54abb8b7-f6d5-4303-bf8c-98cf33ba3564 service nova] Creating event network-changed:791b6e53-c814-4742-81f0-e3cfd45597e8 for instance eb26ced2-9107-42de-bf41-f626a3a59489 on hv-cinder-81268 Jun 29 12:44:56.672207 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-d3e344c6-7ff1-4b03-bf09-ad003069ffb4 req-54abb8b7-f6d5-4303-bf8c-98cf33ba3564 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069760 Jun 29 12:44:56.678183 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 460/942] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:44:56.859551 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-70fdb4e5-928f-4a32-8a7b-9f7d69beb982 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:44:56.869533 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-70fdb4e5-928f-4a32-8a7b-9f7d69beb982 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1760 microversion: 2.1 time: 0.272070 Jun 29 12:44:56.870473 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 483/943] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:44:56 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1760 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:45:19.173697 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2a3ad4f0-79fe-4fe9-9b69-3d0199b1479e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:45:19.175242 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2a3ad4f0-79fe-4fe9-9b69-3d0199b1479e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:45:19.177723 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=3 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:45:19.178368 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=5 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:45:19.184344 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2a3ad4f0-79fe-4fe9-9b69-3d0199b1479e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:19.184785 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2a3ad4f0-79fe-4fe9-9b69-3d0199b1479e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:19.185553 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2a3ad4f0-79fe-4fe9-9b69-3d0199b1479e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:19.185995 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2a3ad4f0-79fe-4fe9-9b69-3d0199b1479e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:19.258888 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2a3ad4f0-79fe-4fe9-9b69-3d0199b1479e tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "POST /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489/action" status: 202 len: 0 microversion: 2.1 time: 0.089229 Jun 29 12:45:19.262275 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 461/944] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 12:45:19 2022] POST /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:45:19.268254 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8d21f068-859a-4778-ab33-60e212a921d3 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:45:19.269488 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8d21f068-859a-4778-ab33-60e212a921d3 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:45:19.273290 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:45:19.273936 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=5 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:45:19.278751 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8d21f068-859a-4778-ab33-60e212a921d3 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:19.279331 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8d21f068-859a-4778-ab33-60e212a921d3 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:19.280999 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8d21f068-859a-4778-ab33-60e212a921d3 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:19.281630 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8d21f068-859a-4778-ab33-60e212a921d3 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:19.434750 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8d21f068-859a-4778-ab33-60e212a921d3 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:45:19.442767 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8d21f068-859a-4778-ab33-60e212a921d3 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1752 microversion: 2.1 time: 0.179054 Jun 29 12:45:19.443324 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 484/945] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:45:19 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:45:20.461340 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-6b07492d-14ff-4f14-97b6-8fe5f6dfcc91 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:45:20.461951 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-6b07492d-14ff-4f14-97b6-8fe5f6dfcc91 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:45:20.468223 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6b07492d-14ff-4f14-97b6-8fe5f6dfcc91 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:20.468673 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6b07492d-14ff-4f14-97b6-8fe5f6dfcc91 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:20.469435 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6b07492d-14ff-4f14-97b6-8fe5f6dfcc91 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:20.469877 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-6b07492d-14ff-4f14-97b6-8fe5f6dfcc91 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:20.616190 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-6b07492d-14ff-4f14-97b6-8fe5f6dfcc91 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:45:20.624142 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-6b07492d-14ff-4f14-97b6-8fe5f6dfcc91 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1757 microversion: 2.1 time: 0.167862 Jun 29 12:45:20.624702 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 462/946] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:45:20 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:45:21.641690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-46713166-1f30-4491-b5c7-9ee591c1d278 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:45:21.642218 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-46713166-1f30-4491-b5c7-9ee591c1d278 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:45:21.649598 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-46713166-1f30-4491-b5c7-9ee591c1d278 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:21.650049 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-46713166-1f30-4491-b5c7-9ee591c1d278 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:21.650832 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-46713166-1f30-4491-b5c7-9ee591c1d278 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:21.651270 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-46713166-1f30-4491-b5c7-9ee591c1d278 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:21.793123 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-46713166-1f30-4491-b5c7-9ee591c1d278 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:45:21.800958 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-46713166-1f30-4491-b5c7-9ee591c1d278 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1757 microversion: 2.1 time: 0.163187 Jun 29 12:45:21.801519 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 485/947] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:45:21 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:45:22.817796 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-429f2c5e-7d30-4be2-9b66-a932ac8217bc tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:45:22.818440 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-429f2c5e-7d30-4be2-9b66-a932ac8217bc tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:45:22.825107 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-429f2c5e-7d30-4be2-9b66-a932ac8217bc tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:22.825562 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-429f2c5e-7d30-4be2-9b66-a932ac8217bc tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:22.826333 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-429f2c5e-7d30-4be2-9b66-a932ac8217bc tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:22.826800 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-429f2c5e-7d30-4be2-9b66-a932ac8217bc tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:22.967029 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-429f2c5e-7d30-4be2-9b66-a932ac8217bc tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:45:22.975604 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-429f2c5e-7d30-4be2-9b66-a932ac8217bc tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1757 microversion: 2.1 time: 0.161689 Jun 29 12:45:22.976152 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 463/948] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:45:22 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:45:23.992689 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-70a97628-c749-4b40-a0cc-7152a4822d72 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:45:23.993317 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-70a97628-c749-4b40-a0cc-7152a4822d72 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:45:23.999683 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-70a97628-c749-4b40-a0cc-7152a4822d72 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:24.000147 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-70a97628-c749-4b40-a0cc-7152a4822d72 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:24.000897 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-70a97628-c749-4b40-a0cc-7152a4822d72 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:24.001328 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-70a97628-c749-4b40-a0cc-7152a4822d72 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:24.141543 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-70a97628-c749-4b40-a0cc-7152a4822d72 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:45:24.150144 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-70a97628-c749-4b40-a0cc-7152a4822d72 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1757 microversion: 2.1 time: 0.161323 Jun 29 12:45:24.150733 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 486/949] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:45:23 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:45:25.166875 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-7d9675ef-c381-4142-9f6d-3a6e397926a3 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:45:25.167490 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-7d9675ef-c381-4142-9f6d-3a6e397926a3 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:45:25.174670 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7d9675ef-c381-4142-9f6d-3a6e397926a3 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:25.175235 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7d9675ef-c381-4142-9f6d-3a6e397926a3 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:25.176009 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7d9675ef-c381-4142-9f6d-3a6e397926a3 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:25.176453 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-7d9675ef-c381-4142-9f6d-3a6e397926a3 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:25.319565 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-7d9675ef-c381-4142-9f6d-3a6e397926a3 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:45:25.327465 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-7d9675ef-c381-4142-9f6d-3a6e397926a3 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1757 microversion: 2.1 time: 0.164463 Jun 29 12:45:25.328025 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 464/950] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:45:25 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:45:26.344529 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b6f715a9-b844-4c33-81ae-6869fb99d51b tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:45:26.345143 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b6f715a9-b844-4c33-81ae-6869fb99d51b tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:45:26.352284 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b6f715a9-b844-4c33-81ae-6869fb99d51b tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:26.352735 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b6f715a9-b844-4c33-81ae-6869fb99d51b tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:26.353501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b6f715a9-b844-4c33-81ae-6869fb99d51b tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:26.353935 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b6f715a9-b844-4c33-81ae-6869fb99d51b tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:26.498671 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-b6f715a9-b844-4c33-81ae-6869fb99d51b tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:45:26.507322 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b6f715a9-b844-4c33-81ae-6869fb99d51b tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1757 microversion: 2.1 time: 0.166641 Jun 29 12:45:26.507901 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 487/951] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:45:26 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:45:27.525207 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-554f639d-804a-4383-98f8-e75f108d387d tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:45:27.525813 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-554f639d-804a-4383-98f8-e75f108d387d tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:45:27.532299 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-554f639d-804a-4383-98f8-e75f108d387d tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:27.532745 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-554f639d-804a-4383-98f8-e75f108d387d tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:27.534134 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-554f639d-804a-4383-98f8-e75f108d387d tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:27.534691 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-554f639d-804a-4383-98f8-e75f108d387d tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:27.676239 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-554f639d-804a-4383-98f8-e75f108d387d tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:45:27.684297 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-554f639d-804a-4383-98f8-e75f108d387d tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1757 microversion: 2.1 time: 0.163228 Jun 29 12:45:27.684859 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 465/952] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:45:27 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:45:28.702161 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5a601cb0-2a4b-4a91-a807-c5216399cf78 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:45:28.702746 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5a601cb0-2a4b-4a91-a807-c5216399cf78 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:45:28.709673 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5a601cb0-2a4b-4a91-a807-c5216399cf78 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:28.710125 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5a601cb0-2a4b-4a91-a807-c5216399cf78 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:28.710918 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5a601cb0-2a4b-4a91-a807-c5216399cf78 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:28.711355 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5a601cb0-2a4b-4a91-a807-c5216399cf78 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:28.855212 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5a601cb0-2a4b-4a91-a807-c5216399cf78 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:45:28.863406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5a601cb0-2a4b-4a91-a807-c5216399cf78 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1757 microversion: 2.1 time: 0.165247 Jun 29 12:45:28.863973 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 488/953] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:45:28 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:45:29.880196 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f2c2c19e-efbe-4e41-b9db-345fbba3eca5 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:45:29.880806 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f2c2c19e-efbe-4e41-b9db-345fbba3eca5 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:45:29.887361 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f2c2c19e-efbe-4e41-b9db-345fbba3eca5 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:29.887803 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f2c2c19e-efbe-4e41-b9db-345fbba3eca5 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:29.888555 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f2c2c19e-efbe-4e41-b9db-345fbba3eca5 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:29.888986 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f2c2c19e-efbe-4e41-b9db-345fbba3eca5 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:30.033867 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f2c2c19e-efbe-4e41-b9db-345fbba3eca5 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:45:30.041919 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f2c2c19e-efbe-4e41-b9db-345fbba3eca5 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1757 microversion: 2.1 time: 0.166124 Jun 29 12:45:30.042512 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 466/954] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:45:29 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:45:31.059121 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5c3c333b-a05e-4f03-937b-0000b163bd04 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:45:31.059762 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5c3c333b-a05e-4f03-937b-0000b163bd04 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:45:31.066479 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5c3c333b-a05e-4f03-937b-0000b163bd04 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:31.066937 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5c3c333b-a05e-4f03-937b-0000b163bd04 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:31.067705 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5c3c333b-a05e-4f03-937b-0000b163bd04 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:31.068145 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-5c3c333b-a05e-4f03-937b-0000b163bd04 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:31.210722 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5c3c333b-a05e-4f03-937b-0000b163bd04 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:45:31.218584 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5c3c333b-a05e-4f03-937b-0000b163bd04 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1757 microversion: 2.1 time: 0.163327 Jun 29 12:45:31.219165 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 489/955] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:45:31 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:45:32.237467 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c912c472-94ad-4f54-aa2b-ee3260474892 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:45:32.238150 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c912c472-94ad-4f54-aa2b-ee3260474892 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:45:32.244939 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c912c472-94ad-4f54-aa2b-ee3260474892 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:32.245394 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c912c472-94ad-4f54-aa2b-ee3260474892 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:32.246197 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c912c472-94ad-4f54-aa2b-ee3260474892 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:32.246664 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c912c472-94ad-4f54-aa2b-ee3260474892 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:32.467584 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c912c472-94ad-4f54-aa2b-ee3260474892 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:45:32.475581 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c912c472-94ad-4f54-aa2b-ee3260474892 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1757 microversion: 2.1 time: 0.242510 Jun 29 12:45:32.476137 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 467/956] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:45:32 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1757 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:45:33.492973 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8070e2ed-d346-4bc8-b68c-ffe1ab516593 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:45:33.493572 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8070e2ed-d346-4bc8-b68c-ffe1ab516593 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:45:33.499733 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8070e2ed-d346-4bc8-b68c-ffe1ab516593 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:33.500173 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8070e2ed-d346-4bc8-b68c-ffe1ab516593 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:33.500916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8070e2ed-d346-4bc8-b68c-ffe1ab516593 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:33.501346 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8070e2ed-d346-4bc8-b68c-ffe1ab516593 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:33.644505 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8070e2ed-d346-4bc8-b68c-ffe1ab516593 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:45:33.652641 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8070e2ed-d346-4bc8-b68c-ffe1ab516593 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1757 microversion: 2.1 time: 0.163576 Jun 29 12:45:33.653196 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 490/957] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:45:33 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:45:34.670171 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d292d62f-abd5-415e-ab55-2e803fed7a7c tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:45:34.670747 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d292d62f-abd5-415e-ab55-2e803fed7a7c tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:45:34.678161 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d292d62f-abd5-415e-ab55-2e803fed7a7c tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:34.678636 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d292d62f-abd5-415e-ab55-2e803fed7a7c tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:34.679398 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d292d62f-abd5-415e-ab55-2e803fed7a7c tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:34.679836 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d292d62f-abd5-415e-ab55-2e803fed7a7c tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:34.823962 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d292d62f-abd5-415e-ab55-2e803fed7a7c tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:45:34.832785 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d292d62f-abd5-415e-ab55-2e803fed7a7c tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1757 microversion: 2.1 time: 0.166546 Jun 29 12:45:34.833345 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 468/958] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:45:34 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:45:35.850136 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-1ad10d58-3a92-470a-ac91-a5353da240f4 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:45:35.850786 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-1ad10d58-3a92-470a-ac91-a5353da240f4 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:45:35.857249 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1ad10d58-3a92-470a-ac91-a5353da240f4 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:35.857700 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1ad10d58-3a92-470a-ac91-a5353da240f4 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:35.858495 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1ad10d58-3a92-470a-ac91-a5353da240f4 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:35.858966 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-1ad10d58-3a92-470a-ac91-a5353da240f4 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:36.006359 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-1ad10d58-3a92-470a-ac91-a5353da240f4 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:45:36.014276 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-1ad10d58-3a92-470a-ac91-a5353da240f4 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1757 microversion: 2.1 time: 0.168682 Jun 29 12:45:36.014879 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 491/959] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:45:35 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:45:37.031791 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ff344bd6-d857-4898-96d6-d8c433f3853f tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:45:37.032410 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ff344bd6-d857-4898-96d6-d8c433f3853f tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:45:37.039155 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ff344bd6-d857-4898-96d6-d8c433f3853f tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:37.039608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ff344bd6-d857-4898-96d6-d8c433f3853f tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:37.040374 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ff344bd6-d857-4898-96d6-d8c433f3853f tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:45:37.040816 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ff344bd6-d857-4898-96d6-d8c433f3853f tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:45:37.182296 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ff344bd6-d857-4898-96d6-d8c433f3853f tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:45:37.190148 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ff344bd6-d857-4898-96d6-d8c433f3853f tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1760 microversion: 2.1 time: 0.162241 Jun 29 12:45:37.190730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 469/960] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:45:37 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1760 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:46:07.885415 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e54cef19-25d9-4787-bd34-bd9a5ac79fee tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1571066103"}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:46:07.886091 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e54cef19-25d9-4787-bd34-bd9a5ac79fee tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:46:07.888109 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=16 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:46:07.888777 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=48 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:46:07.895175 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e54cef19-25d9-4787-bd34-bd9a5ac79fee tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:07.895631 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e54cef19-25d9-4787-bd34-bd9a5ac79fee tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:07.896658 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e54cef19-25d9-4787-bd34-bd9a5ac79fee tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:07.897444 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-e54cef19-25d9-4787-bd34-bd9a5ac79fee tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:08.026540 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.network.security_group_api [None req-e54cef19-25d9-4787-bd34-bd9a5ac79fee tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Removing security group 0c7d11df-14d9-46c8-8844-854b574565ac from port 791b6e53-c814-4742-81f0-e3cfd45597e8 Jun 29 12:46:08.387520 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e54cef19-25d9-4787-bd34-bd9a5ac79fee tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "POST /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489/action" status: 202 len: 0 microversion: 2.1 time: 0.506154 Jun 29 12:46:08.399550 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 492/961] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Jun 29 12:46:07 2022] POST /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:46:08.400230 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-448bad9b-6e4e-4edd-a511-35e42645bf86 req-dc3cda47-6119-420a-8ace-8694658e7143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb26ced2-9107-42de-bf41-f626a3a59489", "tag": "791b6e53-c814-4742-81f0-e3cfd45597e8"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:46:08.404627 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=18 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:46:08.408261 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:46:08.423664 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-448bad9b-6e4e-4edd-a511-35e42645bf86 req-dc3cda47-6119-420a-8ace-8694658e7143 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:08.425505 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-448bad9b-6e4e-4edd-a511-35e42645bf86 req-dc3cda47-6119-420a-8ace-8694658e7143 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:08.457803 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-448bad9b-6e4e-4edd-a511-35e42645bf86 req-dc3cda47-6119-420a-8ace-8694658e7143 service nova] Creating event network-changed:791b6e53-c814-4742-81f0-e3cfd45597e8 for instance eb26ced2-9107-42de-bf41-f626a3a59489 on hv-cinder-81268 Jun 29 12:46:08.466281 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-448bad9b-6e4e-4edd-a511-35e42645bf86 req-dc3cda47-6119-420a-8ace-8694658e7143 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072316 Jun 29 12:46:08.470544 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 470/962] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:46:09.769328 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4e7bdf76-cb2a-436b-b435-7e2695121fba tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:46:09.769913 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4e7bdf76-cb2a-436b-b435-7e2695121fba tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:46:09.776393 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4e7bdf76-cb2a-436b-b435-7e2695121fba tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:09.776841 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4e7bdf76-cb2a-436b-b435-7e2695121fba tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:09.777604 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4e7bdf76-cb2a-436b-b435-7e2695121fba tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:09.778038 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-4e7bdf76-cb2a-436b-b435-7e2695121fba tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:09.858977 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.objects.instance [None req-4e7bdf76-cb2a-436b-b435-7e2695121fba tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lazy-loading 'services' on Instance uuid eb26ced2-9107-42de-bf41-f626a3a59489 {{(pid=124317) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 12:46:09.935770 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4e7bdf76-cb2a-436b-b435-7e2695121fba tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "DELETE /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489/os-volume_attachments/b049cd85-1824-47ed-9e4e-c48e84230581" status: 202 len: 0 microversion: 2.1 time: 0.170246 Jun 29 12:46:09.939257 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 493/963] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 12:46:09 2022] DELETE /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489/os-volume_attachments/b049cd85-1824-47ed-9e4e-c48e84230581 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:46:09.945273 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f5a5e146-511b-4119-98cb-34385e670b74 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:46:09.946301 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f5a5e146-511b-4119-98cb-34385e670b74 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:46:09.954539 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f5a5e146-511b-4119-98cb-34385e670b74 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:09.955003 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f5a5e146-511b-4119-98cb-34385e670b74 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:09.955798 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f5a5e146-511b-4119-98cb-34385e670b74 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:09.956241 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f5a5e146-511b-4119-98cb-34385e670b74 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:09.988227 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f5a5e146-511b-4119-98cb-34385e670b74 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047204 Jun 29 12:46:09.989165 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 471/964] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 12:46:09 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:46:10.482321 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-0736dce4-ce1a-4f13-997e-e416ff615e32 req-4088d0c6-9c53-4c06-ac73-7a5726d4cd68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb26ced2-9107-42de-bf41-f626a3a59489", "tag": "791b6e53-c814-4742-81f0-e3cfd45597e8"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:46:10.490961 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-0736dce4-ce1a-4f13-997e-e416ff615e32 req-4088d0c6-9c53-4c06-ac73-7a5726d4cd68 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:10.491406 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-0736dce4-ce1a-4f13-997e-e416ff615e32 req-4088d0c6-9c53-4c06-ac73-7a5726d4cd68 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:10.502461 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-0736dce4-ce1a-4f13-997e-e416ff615e32 req-4088d0c6-9c53-4c06-ac73-7a5726d4cd68 service nova] Creating event network-changed:791b6e53-c814-4742-81f0-e3cfd45597e8 for instance eb26ced2-9107-42de-bf41-f626a3a59489 on hv-cinder-81268 Jun 29 12:46:10.507959 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-0736dce4-ce1a-4f13-997e-e416ff615e32 req-4088d0c6-9c53-4c06-ac73-7a5726d4cd68 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029450 Jun 29 12:46:10.508568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 494/965] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:46:11.001333 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8857461f-0bb1-466b-a422-4eeb249e0398 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:46:11.002374 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8857461f-0bb1-466b-a422-4eeb249e0398 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:46:11.009701 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8857461f-0bb1-466b-a422-4eeb249e0398 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:11.010154 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8857461f-0bb1-466b-a422-4eeb249e0398 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:11.010959 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8857461f-0bb1-466b-a422-4eeb249e0398 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:11.011494 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8857461f-0bb1-466b-a422-4eeb249e0398 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:11.040227 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8857461f-0bb1-466b-a422-4eeb249e0398 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042890 Jun 29 12:46:11.040778 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 472/966] 10.222.0.52 () {58 vars in 1301 bytes} [Wed Jun 29 12:46:10 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 12:46:11.051847 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0c47f964-d640-4219-8c46-c79286cbac9b tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:46:11.052913 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0c47f964-d640-4219-8c46-c79286cbac9b tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:46:11.059910 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0c47f964-d640-4219-8c46-c79286cbac9b tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:11.060355 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0c47f964-d640-4219-8c46-c79286cbac9b tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:11.061104 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0c47f964-d640-4219-8c46-c79286cbac9b tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:11.061536 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0c47f964-d640-4219-8c46-c79286cbac9b tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:11.136777 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-0c47f964-d640-4219-8c46-c79286cbac9b tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] HTTP exception thrown: Instance eb26ced2-9107-42de-bf41-f626a3a59489 is not attached to volume b049cd85-1824-47ed-9e4e-c48e84230581 Jun 29 12:46:11.139213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0c47f964-d640-4219-8c46-c79286cbac9b tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Request method failure captured: Jun 29 12:46:11.139213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: DELETE /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489/os-volume_attachments/b049cd85-1824-47ed-9e4e-c48e84230581 HTTP/1.1 Jun 29 12:46:11.139213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:46:11.139213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:46:11.139213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:46:11.139213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:46:11.139213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:46:11.139213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:46:11.139213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:46:11.139213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:46:11.139213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEkb7rNiQgaxlTfEUvnhJ72yh8SjK1B7-yn2LP218M4d_ybrozf9HEMS3LiuF1pl9ZoDzc1g3ORB2Ek4alfBipXnOzZqfDET3JeBfpbmI3Nu2uIIBFfjrM90H93O3c3Z6I9wThozppyPSGiiPZzcjgXCJ2ICWmFUvJ8yRM73Aiwpz3w Jun 29 12:46:11.139213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:46:11.139213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:46:11.139213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:46:11.139213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:46:11.139213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:46:11.139213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:46:11.139213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: 925a9005d7494b04923bdaa194731362 Jun 29 12:46:11.139213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-TestMinimumBasicScenario-381604302 Jun 29 12:46:11.139213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:46:11.139213 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:46:11.140913 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_925a9005d7494b04923bdaa194731362", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/925a9005d7494b04923bdaa194731362"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/925a9005d7494b04923bdaa194731362"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/925a9005d7494b04923bdaa194731362"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:46:11.140913 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-TestMinimumBasicScenario-381604302 Jun 29 12:46:11.140913 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 925a9005d7494b04923bdaa194731362 Jun 29 12:46:11.140913 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-TestMinimumBasicScenario-381604302 Jun 29 12:46:11.140913 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-TestMinimumBasicScenario-381604302-project Jun 29 12:46:11.140913 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:46:11.140913 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:46:11.140913 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: fd70c574b180445f9348d9aee8ac4c82 Jun 29 12:46:11.140913 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-TestMinimumBasicScenario-381604302-project Jun 29 12:46:11.140913 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:46:11.140913 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Instance eb26ced2-9107-42de-bf41-f626a3a59489 is not attached to volume b049cd85-1824-47ed-9e4e-c48e84230581 Jun 29 12:46:11.141863 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'server_id': 'eb26ced2-9107-42de-bf41-f626a3a59489', 'id': 'b049cd85-1824-47ed-9e4e-c48e84230581'} Jun 29 12:46:11.141863 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:46:11.141863 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:46:11.141863 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 29 12:46:11.141863 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 29 12:46:11.141863 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 12:46:11.141863 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 12:46:11.141863 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 29 12:46:11.141863 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 29 12:46:11.141863 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b049cd85-1824-47ed-9e4e-c48e84230581. Jun 29 12:46:11.141863 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:46:11.141863 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:46:11.141863 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:46:11.141863 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:46:11.141863 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:46:11.141863 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:46:11.141863 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:46:11.141863 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:46:11.141863 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:46:11.143501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:46:11.143501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 29 12:46:11.143501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 29 12:46:11.143501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb26ced2-9107-42de-bf41-f626a3a59489 is not attached to volume b049cd85-1824-47ed-9e4e-c48e84230581 Jun 29 12:46:11.143501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:46:11.143501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:46:11.143501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:46:11.143501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:46:11.143501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:46:11.143501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:46:11.143501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:46:11.143501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:46:11.143501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb26ced2-9107-42de-bf41-f626a3a59489 is not attached to volume b049cd85-1824-47ed-9e4e-c48e84230581 Jun 29 12:46:11.143501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:46:11.143501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0c47f964-d640-4219-8c46-c79286cbac9b tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Returning 404 to user: Instance eb26ced2-9107-42de-bf41-f626a3a59489 is not attached to volume b049cd85-1824-47ed-9e4e-c48e84230581 {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:46:11.144909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0c47f964-d640-4219-8c46-c79286cbac9b tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "DELETE /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489/os-volume_attachments/b049cd85-1824-47ed-9e4e-c48e84230581" status: 404 len: 154 microversion: 2.1 time: 0.093183 Jun 29 12:46:11.144909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 495/967] 10.222.0.52 () {58 vars in 1415 bytes} [Wed Jun 29 12:46:11 2022] DELETE /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489/os-volume_attachments/b049cd85-1824-47ed-9e4e-c48e84230581 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:46:12.276329 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-2290b96a-c073-423a-b3be-50fc61923622 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:46:12.276819 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2290b96a-c073-423a-b3be-50fc61923622 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:46:12.283180 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2290b96a-c073-423a-b3be-50fc61923622 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:12.283630 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2290b96a-c073-423a-b3be-50fc61923622 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:12.284386 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2290b96a-c073-423a-b3be-50fc61923622 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:12.284822 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-2290b96a-c073-423a-b3be-50fc61923622 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:12.308451 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-2290b96a-c073-423a-b3be-50fc61923622 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 12:46:12.381356 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-2290b96a-c073-423a-b3be-50fc61923622 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "DELETE /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 204 len: 0 microversion: 2.1 time: 0.108984 Jun 29 12:46:12.382191 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 473/968] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:46:12 2022] DELETE /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 12:46:12.390370 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-aec0c811-9c5d-46a6-924a-95ba5ec04706 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:46:12.390998 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-aec0c811-9c5d-46a6-924a-95ba5ec04706 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:46:12.398082 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aec0c811-9c5d-46a6-924a-95ba5ec04706 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:12.398801 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aec0c811-9c5d-46a6-924a-95ba5ec04706 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:12.399550 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aec0c811-9c5d-46a6-924a-95ba5ec04706 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:12.399980 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-aec0c811-9c5d-46a6-924a-95ba5ec04706 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:12.526885 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-aec0c811-9c5d-46a6-924a-95ba5ec04706 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:46:12.534268 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-aec0c811-9c5d-46a6-924a-95ba5ec04706 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1554 microversion: 2.1 time: 0.147810 Jun 29 12:46:12.534852 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 496/969] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:46:12 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:46:13.552978 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-84955ea8-9663-4aef-8a2e-953c7c6e9a6b tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:46:13.553904 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-84955ea8-9663-4aef-8a2e-953c7c6e9a6b tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:46:13.560465 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-84955ea8-9663-4aef-8a2e-953c7c6e9a6b tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:13.560916 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-84955ea8-9663-4aef-8a2e-953c7c6e9a6b tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:13.561687 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-84955ea8-9663-4aef-8a2e-953c7c6e9a6b tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:13.562162 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-84955ea8-9663-4aef-8a2e-953c7c6e9a6b tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:13.692551 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-84955ea8-9663-4aef-8a2e-953c7c6e9a6b tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:46:13.700116 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-84955ea8-9663-4aef-8a2e-953c7c6e9a6b tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1554 microversion: 2.1 time: 0.151901 Jun 29 12:46:13.700678 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 474/970] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:46:13 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:46:14.471902 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-5ba52ab6-8a6d-4c13-bbe0-3c974c4ab7a8 req-40c86de5-9ee0-49d9-86bb-3aa7b3c898ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb26ced2-9107-42de-bf41-f626a3a59489", "name": "network-vif-deleted", "tag": "791b6e53-c814-4742-81f0-e3cfd45597e8"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:46:14.481322 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-5ba52ab6-8a6d-4c13-bbe0-3c974c4ab7a8 req-40c86de5-9ee0-49d9-86bb-3aa7b3c898ee service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:14.481863 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-5ba52ab6-8a6d-4c13-bbe0-3c974c4ab7a8 req-40c86de5-9ee0-49d9-86bb-3aa7b3c898ee service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:14.493966 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-5ba52ab6-8a6d-4c13-bbe0-3c974c4ab7a8 req-40c86de5-9ee0-49d9-86bb-3aa7b3c898ee service nova] Creating event network-vif-deleted:791b6e53-c814-4742-81f0-e3cfd45597e8 for instance eb26ced2-9107-42de-bf41-f626a3a59489 on hv-cinder-81268 Jun 29 12:46:14.498730 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-5ba52ab6-8a6d-4c13-bbe0-3c974c4ab7a8 req-40c86de5-9ee0-49d9-86bb-3aa7b3c898ee service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030647 Jun 29 12:46:14.499348 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 497/971] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:46:14.716991 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d5083935-6501-4b04-aaa9-4fa896522809 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:46:14.717546 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d5083935-6501-4b04-aaa9-4fa896522809 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:46:14.724051 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d5083935-6501-4b04-aaa9-4fa896522809 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:14.725124 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d5083935-6501-4b04-aaa9-4fa896522809 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:14.725990 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d5083935-6501-4b04-aaa9-4fa896522809 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:14.726448 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d5083935-6501-4b04-aaa9-4fa896522809 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:14.758022 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d5083935-6501-4b04-aaa9-4fa896522809 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:14.758530 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d5083935-6501-4b04-aaa9-4fa896522809 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:14.759203 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-d5083935-6501-4b04-aaa9-4fa896522809 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lazy-loading 'fault' on Instance uuid eb26ced2-9107-42de-bf41-f626a3a59489 {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 12:46:14.804752 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d5083935-6501-4b04-aaa9-4fa896522809 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd70c574b180445f9348d9aee8ac4c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '925a9005d7494b04923bdaa194731362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:46:14.812522 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d5083935-6501-4b04-aaa9-4fa896522809 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 200 len: 1348 microversion: 2.1 time: 0.099422 Jun 29 12:46:14.813349 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 475/972] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:46:14 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 1348 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:46:15.830295 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-76281b6e-ab8b-4878-9456-8a7382778ee6 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:46:15.831022 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-76281b6e-ab8b-4878-9456-8a7382778ee6 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] [instance: eb26ced2-9107-42de-bf41-f626a3a59489] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:46:15.837198 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-76281b6e-ab8b-4878-9456-8a7382778ee6 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:15.837640 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-76281b6e-ab8b-4878-9456-8a7382778ee6 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:15.838393 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-76281b6e-ab8b-4878-9456-8a7382778ee6 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:15.838849 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-76281b6e-ab8b-4878-9456-8a7382778ee6 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:15.852254 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-76281b6e-ab8b-4878-9456-8a7382778ee6 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] HTTP exception thrown: Instance eb26ced2-9107-42de-bf41-f626a3a59489 could not be found. Jun 29 12:46:15.853851 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-76281b6e-ab8b-4878-9456-8a7382778ee6 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Request method failure captured: Jun 29 12:46:15.853851 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 HTTP/1.1 Jun 29 12:46:15.853851 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:46:15.853851 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:46:15.853851 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:46:15.853851 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:46:15.853851 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:46:15.853851 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:46:15.853851 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:46:15.853851 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:46:15.853851 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEkb7rNiQgaxlTfEUvnhJ72yh8SjK1B7-yn2LP218M4d_ybrozf9HEMS3LiuF1pl9ZoDzc1g3ORB2Ek4alfBipXnOzZqfDET3JeBfpbmI3Nu2uIIBFfjrM90H93O3c3Z6I9wThozppyPSGiiPZzcjgXCJ2ICWmFUvJ8yRM73Aiwpz3w Jun 29 12:46:15.853851 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:46:15.853851 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:46:15.853851 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:46:15.853851 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:46:15.853851 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:46:15.853851 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:46:15.853851 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: 925a9005d7494b04923bdaa194731362 Jun 29 12:46:15.853851 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-TestMinimumBasicScenario-381604302 Jun 29 12:46:15.853851 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:46:15.853851 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:46:15.855566 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_925a9005d7494b04923bdaa194731362", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/925a9005d7494b04923bdaa194731362"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/925a9005d7494b04923bdaa194731362"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/925a9005d7494b04923bdaa194731362"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:46:15.855566 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-TestMinimumBasicScenario-381604302 Jun 29 12:46:15.855566 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 925a9005d7494b04923bdaa194731362 Jun 29 12:46:15.855566 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-TestMinimumBasicScenario-381604302 Jun 29 12:46:15.855566 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-TestMinimumBasicScenario-381604302-project Jun 29 12:46:15.855566 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:46:15.855566 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:46:15.855566 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: fd70c574b180445f9348d9aee8ac4c82 Jun 29 12:46:15.855566 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-TestMinimumBasicScenario-381604302-project Jun 29 12:46:15.855566 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:46:15.855566 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Instance eb26ced2-9107-42de-bf41-f626a3a59489 could not be found. Jun 29 12:46:15.855566 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': 'eb26ced2-9107-42de-bf41-f626a3a59489'} Jun 29 12:46:15.856690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:46:15.856690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:46:15.856690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:46:15.856690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:46:15.856690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:46:15.856690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:46:15.856690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:46:15.856690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:46:15.856690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:46:15.856690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:46:15.856690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb26ced2-9107-42de-bf41-f626a3a59489 could not be found. Jun 29 12:46:15.856690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:46:15.856690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:46:15.856690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:46:15.856690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:46:15.856690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:46:15.856690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:46:15.856690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:46:15.856690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:46:15.856690 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:46:15.858295 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:46:15.858295 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:46:15.858295 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:46:15.858295 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:46:15.858295 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:46:15.858295 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:46:15.858295 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:46:15.858295 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb26ced2-9107-42de-bf41-f626a3a59489 could not be found. Jun 29 12:46:15.858295 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:46:15.858295 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:46:15.858295 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:46:15.858295 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:46:15.858295 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:46:15.858295 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:46:15.858295 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:46:15.858295 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:46:15.858295 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb26ced2-9107-42de-bf41-f626a3a59489 could not be found. Jun 29 12:46:15.858295 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:46:15.859888 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-76281b6e-ab8b-4878-9456-8a7382778ee6 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Returning 404 to user: Instance eb26ced2-9107-42de-bf41-f626a3a59489 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:46:15.859888 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-76281b6e-ab8b-4878-9456-8a7382778ee6 tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489" status: 404 len: 111 microversion: 2.1 time: 0.029612 Jun 29 12:46:15.859888 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 498/973] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:46:15 2022] GET /compute/v2.1/servers/eb26ced2-9107-42de-bf41-f626a3a59489 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 12:46:15.864553 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-96632690-9505-4574-9dfc-885a01f4f9eb tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] Calling method '.version_select at 0x7fdb06837040>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:46:15.882207 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-96632690-9505-4574-9dfc-885a01f4f9eb tempest-TestMinimumBasicScenario-381604302 tempest-TestMinimumBasicScenario-381604302-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1192223444" status: 202 len: 0 microversion: 2.1 time: 0.021434 Jun 29 12:46:15.882789 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 476/974] 10.222.0.52 () {58 vars in 1271 bytes} [Wed Jun 29 12:46:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1192223444 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:46:33.496225 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=14 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:46:33.497003 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:46:33.709822 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-46dc4b03-638d-4f7e-9a27-323d1cf74768 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Action: 'create', calling method: .version_select at 0x7fdb06a31940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-260463289", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQVj7NJYpZ1f/0VKeMN74Qd4yuJXiJLs4Lar4ZCUow0HU0OPXLHBxvVeIuc5sIYYbgTMZrfH1xBiXc2O4HaxModazyQNg2gmCUaE1NLhS+aSf7MJzBSFgEUyPfjLp0zvA=="}} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:46:33.727781 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-46dc4b03-638d-4f7e-9a27-323d1cf74768 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Getting quotas for project 5c3c5d6a04e74a23984b32760c5b1e87. Resources: {'key_pairs'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:46:33.731905 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.quota [None req-46dc4b03-638d-4f7e-9a27-323d1cf74768 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Getting quotas for user b08abc69fc8e46cea2831101e8d5db87 and project 5c3c5d6a04e74a23984b32760c5b1e87. Resources: {'key_pairs'} {{(pid=124317) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:46:33.744518 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR oslo.messaging._drivers.impl_rabbit [None req-46dc4b03-638d-4f7e-9a27-323d1cf74768 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [4898ec3e-d01f-4379-a9b3-f9d3ca94585b] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 29 12:46:34.752269 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO oslo.messaging._drivers.impl_rabbit [None req-46dc4b03-638d-4f7e-9a27-323d1cf74768 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [4898ec3e-d01f-4379-a9b3-f9d3ca94585b] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 44526. Jun 29 12:46:34.767727 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-46dc4b03-638d-4f7e-9a27-323d1cf74768 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 1.276382 Jun 29 12:46:34.768389 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 499/975] 10.222.0.52 () {60 vars in 1158 bytes} [Wed Jun 29 12:46:33 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:46:49.994338 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:46:49.995111 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:46:49.999276 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ff49e795-0be4-4dec-ac9f-2fc895662f88 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-298173377", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-260463289", "security_groups": [{"name": "tempest-secgroup-smoke-1541791989"}], "block_device_mapping_v2": [{"uuid": "2bb71491-c0c7-481f-b744-09bddf5a4f1b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "78656dd4-2a18-4c61-b4c7-5f35673ea9fe"}]}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:46:50.115802 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.network.neutron [None req-ff49e795-0be4-4dec-ac9f-2fc895662f88 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] validate_networks() for [('78656dd4-2a18-4c61-b4c7-5f35673ea9fe', None, None, None, None, None)] {{(pid=124316) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 12:46:50.569104 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-ff49e795-0be4-4dec-ac9f-2fc895662f88 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Flavor limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 12:46:50.569747 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-ff49e795-0be4-4dec-ac9f-2fc895662f88 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Image limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 12:46:50.570973 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-ff49e795-0be4-4dec-ac9f-2fc895662f88 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Flavor pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 12:46:50.571395 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-ff49e795-0be4-4dec-ac9f-2fc895662f88 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Image pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 12:46:50.571815 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-ff49e795-0be4-4dec-ac9f-2fc895662f88 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 12:46:50.580634 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ff49e795-0be4-4dec-ac9f-2fc895662f88 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:50.581087 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ff49e795-0be4-4dec-ac9f-2fc895662f88 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:50.581882 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ff49e795-0be4-4dec-ac9f-2fc895662f88 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:50.582320 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ff49e795-0be4-4dec-ac9f-2fc895662f88 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:50.599245 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-ff49e795-0be4-4dec-ac9f-2fc895662f88 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Getting quotas for project 5c3c5d6a04e74a23984b32760c5b1e87. Resources: {'cores', 'ram', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:46:50.603152 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-ff49e795-0be4-4dec-ac9f-2fc895662f88 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Getting quotas for user b08abc69fc8e46cea2831101e8d5db87 and project 5c3c5d6a04e74a23984b32760c5b1e87. Resources: {'cores', 'ram', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:46:50.663541 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ff49e795-0be4-4dec-ac9f-2fc895662f88 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Going to run 1 instances... {{(pid=124316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 12:46:50.666127 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ff49e795-0be4-4dec-ac9f-2fc895662f88 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 2e36e163-5fb2-427e-90e6-5ceb3913a184] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2bb71491-c0c7-481f-b744-09bddf5a4f1b',volume_size=None,volume_type=None)] {{(pid=124316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 12:46:50.796418 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ff49e795-0be4-4dec-ac9f-2fc895662f88 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [37676931-7648-4c5a-9cb3-63afabf5f9fe] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 29 12:46:51.803778 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO oslo.messaging._drivers.impl_rabbit [None req-ff49e795-0be4-4dec-ac9f-2fc895662f88 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [37676931-7648-4c5a-9cb3-63afabf5f9fe] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 44654. Jun 29 12:46:51.808569 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ff49e795-0be4-4dec-ac9f-2fc895662f88 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.816202 Jun 29 12:46:51.809219 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 477/976] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 12:46:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 1818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 12:46:51.816401 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=4 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:46:51.817453 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:46:51.822499 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ddaf88e1-8955-4df6-9d88-324ea81f036c tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:46:51.823963 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ddaf88e1-8955-4df6-9d88-324ea81f036c tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 2e36e163-5fb2-427e-90e6-5ceb3913a184] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:46:51.880004 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ddaf88e1-8955-4df6-9d88-324ea81f036c tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:46:51.887865 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ddaf88e1-8955-4df6-9d88-324ea81f036c tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184" status: 200 len: 1093 microversion: 2.1 time: 0.072715 Jun 29 12:46:51.888430 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 500/977] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:46:51 2022] GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184 => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:46:52.906650 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4bb810e0-1fbe-4bcc-b26d-3ad7055db86a tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:46:52.907192 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4bb810e0-1fbe-4bcc-b26d-3ad7055db86a tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 2e36e163-5fb2-427e-90e6-5ceb3913a184] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:46:52.913449 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4bb810e0-1fbe-4bcc-b26d-3ad7055db86a tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:52.913943 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4bb810e0-1fbe-4bcc-b26d-3ad7055db86a tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:52.915033 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4bb810e0-1fbe-4bcc-b26d-3ad7055db86a tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:52.915217 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4bb810e0-1fbe-4bcc-b26d-3ad7055db86a tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:53.015539 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4bb810e0-1fbe-4bcc-b26d-3ad7055db86a tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:46:53.025771 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4bb810e0-1fbe-4bcc-b26d-3ad7055db86a tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184" status: 200 len: 1199 microversion: 2.1 time: 0.123523 Jun 29 12:46:53.026362 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 478/978] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:46:52 2022] GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184 => generated 1199 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:46:54.043539 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-45ae49b2-494f-48b0-8832-2bdf2a0c0ba9 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:46:54.044150 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-45ae49b2-494f-48b0-8832-2bdf2a0c0ba9 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 2e36e163-5fb2-427e-90e6-5ceb3913a184] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:46:54.051225 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-45ae49b2-494f-48b0-8832-2bdf2a0c0ba9 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:54.051683 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-45ae49b2-494f-48b0-8832-2bdf2a0c0ba9 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:54.052446 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-45ae49b2-494f-48b0-8832-2bdf2a0c0ba9 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:54.052883 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-45ae49b2-494f-48b0-8832-2bdf2a0c0ba9 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:54.191811 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-45ae49b2-494f-48b0-8832-2bdf2a0c0ba9 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:46:54.199880 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-45ae49b2-494f-48b0-8832-2bdf2a0c0ba9 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184" status: 200 len: 1265 microversion: 2.1 time: 0.160720 Jun 29 12:46:54.200451 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 501/979] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:46:54 2022] GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:46:54.566130 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-576a9484-cd98-4518-8b08-6ed6c71ebe24 req-b66bec70-04da-41cc-95bf-b1ba13fddc8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e36e163-5fb2-427e-90e6-5ceb3913a184", "tag": "47818afa-8960-424a-b97e-e65a82d72628"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:46:54.575751 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-576a9484-cd98-4518-8b08-6ed6c71ebe24 req-b66bec70-04da-41cc-95bf-b1ba13fddc8e service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:54.576211 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-576a9484-cd98-4518-8b08-6ed6c71ebe24 req-b66bec70-04da-41cc-95bf-b1ba13fddc8e service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:54.592994 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-576a9484-cd98-4518-8b08-6ed6c71ebe24 req-b66bec70-04da-41cc-95bf-b1ba13fddc8e service nova] Creating event network-changed:47818afa-8960-424a-b97e-e65a82d72628 for instance 2e36e163-5fb2-427e-90e6-5ceb3913a184 on hv-cinder-81268 Jun 29 12:46:54.599548 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-576a9484-cd98-4518-8b08-6ed6c71ebe24 req-b66bec70-04da-41cc-95bf-b1ba13fddc8e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036695 Jun 29 12:46:54.600256 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 479/980] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:46:55.217281 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-da05b827-fac1-4786-95d1-175315065d3a tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:46:55.217950 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-da05b827-fac1-4786-95d1-175315065d3a tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 2e36e163-5fb2-427e-90e6-5ceb3913a184] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:46:55.224368 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-da05b827-fac1-4786-95d1-175315065d3a tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:55.224753 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-da05b827-fac1-4786-95d1-175315065d3a tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:55.225512 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-da05b827-fac1-4786-95d1-175315065d3a tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:55.225949 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-da05b827-fac1-4786-95d1-175315065d3a tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:55.362599 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-da05b827-fac1-4786-95d1-175315065d3a tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:46:55.370000 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-da05b827-fac1-4786-95d1-175315065d3a tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184" status: 200 len: 1265 microversion: 2.1 time: 0.156604 Jun 29 12:46:55.370680 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 502/981] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:46:55 2022] GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:46:56.387699 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9eabea04-1111-4d69-adfe-e38b85f2d081 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:46:56.388429 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-9eabea04-1111-4d69-adfe-e38b85f2d081 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 2e36e163-5fb2-427e-90e6-5ceb3913a184] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:46:56.395060 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9eabea04-1111-4d69-adfe-e38b85f2d081 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:56.395507 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9eabea04-1111-4d69-adfe-e38b85f2d081 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:56.396256 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9eabea04-1111-4d69-adfe-e38b85f2d081 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:56.396694 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-9eabea04-1111-4d69-adfe-e38b85f2d081 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:56.533411 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9eabea04-1111-4d69-adfe-e38b85f2d081 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:46:56.542220 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9eabea04-1111-4d69-adfe-e38b85f2d081 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184" status: 200 len: 1265 microversion: 2.1 time: 0.158733 Jun 29 12:46:56.542814 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 480/982] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:46:56 2022] GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:46:57.559348 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-15ee1bc4-3e6e-43dd-b6ff-87646ca794c8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:46:57.559966 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-15ee1bc4-3e6e-43dd-b6ff-87646ca794c8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 2e36e163-5fb2-427e-90e6-5ceb3913a184] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:46:57.566454 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-15ee1bc4-3e6e-43dd-b6ff-87646ca794c8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:57.566915 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-15ee1bc4-3e6e-43dd-b6ff-87646ca794c8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:57.567677 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-15ee1bc4-3e6e-43dd-b6ff-87646ca794c8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:57.568117 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-15ee1bc4-3e6e-43dd-b6ff-87646ca794c8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:57.697283 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-15ee1bc4-3e6e-43dd-b6ff-87646ca794c8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:46:57.704646 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-15ee1bc4-3e6e-43dd-b6ff-87646ca794c8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184" status: 200 len: 1265 microversion: 2.1 time: 0.149203 Jun 29 12:46:57.705210 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 503/983] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:46:57 2022] GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:46:58.721553 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-cd3475f5-fe54-4d28-87c1-979491244bac tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:46:58.722129 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-cd3475f5-fe54-4d28-87c1-979491244bac tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 2e36e163-5fb2-427e-90e6-5ceb3913a184] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:46:58.729133 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cd3475f5-fe54-4d28-87c1-979491244bac tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:58.729723 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cd3475f5-fe54-4d28-87c1-979491244bac tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:58.730502 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cd3475f5-fe54-4d28-87c1-979491244bac tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:58.730944 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cd3475f5-fe54-4d28-87c1-979491244bac tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:58.860171 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-cd3475f5-fe54-4d28-87c1-979491244bac tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:46:58.867894 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-cd3475f5-fe54-4d28-87c1-979491244bac tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184" status: 200 len: 1265 microversion: 2.1 time: 0.150071 Jun 29 12:46:58.868608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 481/984] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:46:58 2022] GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:46:59.885884 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-6342ffb0-deab-48f3-a3ed-2ebdfdeea5a8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:46:59.887868 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-6342ffb0-deab-48f3-a3ed-2ebdfdeea5a8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 2e36e163-5fb2-427e-90e6-5ceb3913a184] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:46:59.893236 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6342ffb0-deab-48f3-a3ed-2ebdfdeea5a8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:59.893683 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6342ffb0-deab-48f3-a3ed-2ebdfdeea5a8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:46:59.894461 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6342ffb0-deab-48f3-a3ed-2ebdfdeea5a8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:46:59.894900 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-6342ffb0-deab-48f3-a3ed-2ebdfdeea5a8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:47:00.028886 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-6342ffb0-deab-48f3-a3ed-2ebdfdeea5a8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:47:00.036358 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-6342ffb0-deab-48f3-a3ed-2ebdfdeea5a8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184" status: 200 len: 1265 microversion: 2.1 time: 0.155411 Jun 29 12:47:00.036917 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 504/985] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:46:59 2022] GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:47:01.053020 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-62258bb6-6b8c-48f1-b871-6dc7512e1e3a tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:47:01.053632 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-62258bb6-6b8c-48f1-b871-6dc7512e1e3a tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 2e36e163-5fb2-427e-90e6-5ceb3913a184] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:47:01.056085 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:47:01.056737 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=6 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:47:01.062434 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-62258bb6-6b8c-48f1-b871-6dc7512e1e3a tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:47:01.062883 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-62258bb6-6b8c-48f1-b871-6dc7512e1e3a tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:47:01.063645 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-62258bb6-6b8c-48f1-b871-6dc7512e1e3a tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:47:01.064077 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-62258bb6-6b8c-48f1-b871-6dc7512e1e3a tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:47:01.194099 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-62258bb6-6b8c-48f1-b871-6dc7512e1e3a tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:47:01.202318 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-62258bb6-6b8c-48f1-b871-6dc7512e1e3a tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184" status: 200 len: 1265 microversion: 2.1 time: 0.153215 Jun 29 12:47:01.202907 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 482/986] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:47:01 2022] GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:47:02.219281 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-56740e42-5b68-4d94-8bae-5eae0b69a905 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:47:02.219803 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-56740e42-5b68-4d94-8bae-5eae0b69a905 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 2e36e163-5fb2-427e-90e6-5ceb3913a184] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:47:02.222125 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:47:02.228165 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-56740e42-5b68-4d94-8bae-5eae0b69a905 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:47:02.228620 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-56740e42-5b68-4d94-8bae-5eae0b69a905 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:47:02.229371 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-56740e42-5b68-4d94-8bae-5eae0b69a905 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:47:02.229806 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-56740e42-5b68-4d94-8bae-5eae0b69a905 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:47:02.362707 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-56740e42-5b68-4d94-8bae-5eae0b69a905 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:47:02.370444 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-56740e42-5b68-4d94-8bae-5eae0b69a905 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184" status: 200 len: 1265 microversion: 2.1 time: 0.155082 Jun 29 12:47:02.371003 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 505/987] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:47:02 2022] GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:47:03.386847 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-cf8b4d22-3245-428e-a0e5-7fa2ec2fec15 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:47:03.387452 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-cf8b4d22-3245-428e-a0e5-7fa2ec2fec15 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 2e36e163-5fb2-427e-90e6-5ceb3913a184] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:47:03.394531 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cf8b4d22-3245-428e-a0e5-7fa2ec2fec15 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:47:03.394740 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cf8b4d22-3245-428e-a0e5-7fa2ec2fec15 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:47:03.395549 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cf8b4d22-3245-428e-a0e5-7fa2ec2fec15 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:47:03.395991 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-cf8b4d22-3245-428e-a0e5-7fa2ec2fec15 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:47:03.533110 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-cf8b4d22-3245-428e-a0e5-7fa2ec2fec15 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:47:03.541878 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-cf8b4d22-3245-428e-a0e5-7fa2ec2fec15 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184" status: 200 len: 1265 microversion: 2.1 time: 0.158885 Jun 29 12:47:03.542642 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 483/988] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:47:03 2022] GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:47:03.555761 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-c20eddf0-657d-4257-ba44-9fadf0f29407 req-f2525a94-f2ab-4825-8cc3-724fe959a2fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e36e163-5fb2-427e-90e6-5ceb3913a184", "name": "network-vif-plugged", "status": "completed", "tag": "47818afa-8960-424a-b97e-e65a82d72628"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:47:03.564580 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-c20eddf0-657d-4257-ba44-9fadf0f29407 req-f2525a94-f2ab-4825-8cc3-724fe959a2fe service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:47:03.565017 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-c20eddf0-657d-4257-ba44-9fadf0f29407 req-f2525a94-f2ab-4825-8cc3-724fe959a2fe service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:47:03.575941 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-c20eddf0-657d-4257-ba44-9fadf0f29407 req-f2525a94-f2ab-4825-8cc3-724fe959a2fe service nova] Creating event network-vif-plugged:47818afa-8960-424a-b97e-e65a82d72628 for instance 2e36e163-5fb2-427e-90e6-5ceb3913a184 on hv-cinder-81268 Jun 29 12:47:03.580875 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-c20eddf0-657d-4257-ba44-9fadf0f29407 req-f2525a94-f2ab-4825-8cc3-724fe959a2fe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028795 Jun 29 12:47:03.581453 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 506/989] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:47:04.559783 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c5a51853-d448-4fc0-85f7-53104312a9d2 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:47:04.560429 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c5a51853-d448-4fc0-85f7-53104312a9d2 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 2e36e163-5fb2-427e-90e6-5ceb3913a184] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:47:04.566928 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c5a51853-d448-4fc0-85f7-53104312a9d2 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:47:04.567380 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c5a51853-d448-4fc0-85f7-53104312a9d2 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:47:04.568147 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c5a51853-d448-4fc0-85f7-53104312a9d2 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:47:04.568585 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c5a51853-d448-4fc0-85f7-53104312a9d2 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:47:04.704022 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-c5a51853-d448-4fc0-85f7-53104312a9d2 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:47:04.712362 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c5a51853-d448-4fc0-85f7-53104312a9d2 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184" status: 200 len: 1265 microversion: 2.1 time: 0.156301 Jun 29 12:47:04.721438 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 484/990] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:47:04 2022] GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:47:05.730353 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-34e71757-862b-48e9-9c9a-1b8dfdcb1b58 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:47:05.731043 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-34e71757-862b-48e9-9c9a-1b8dfdcb1b58 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 2e36e163-5fb2-427e-90e6-5ceb3913a184] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:47:05.737246 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-34e71757-862b-48e9-9c9a-1b8dfdcb1b58 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:47:05.737694 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-34e71757-862b-48e9-9c9a-1b8dfdcb1b58 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:47:05.738473 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-34e71757-862b-48e9-9c9a-1b8dfdcb1b58 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:47:05.738913 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-34e71757-862b-48e9-9c9a-1b8dfdcb1b58 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:47:05.878998 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-34e71757-862b-48e9-9c9a-1b8dfdcb1b58 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:47:05.887699 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-34e71757-862b-48e9-9c9a-1b8dfdcb1b58 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184" status: 200 len: 1452 microversion: 2.1 time: 0.162307 Jun 29 12:47:05.888268 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 507/991] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:47:05 2022] GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:47:05.903920 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d08af61b-9e68-4d46-a25a-9dc0d1fef835 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:47:05.904528 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d08af61b-9e68-4d46-a25a-9dc0d1fef835 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 2e36e163-5fb2-427e-90e6-5ceb3913a184] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:47:05.910873 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d08af61b-9e68-4d46-a25a-9dc0d1fef835 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:47:05.911323 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d08af61b-9e68-4d46-a25a-9dc0d1fef835 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:47:05.912070 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d08af61b-9e68-4d46-a25a-9dc0d1fef835 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:47:05.912505 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d08af61b-9e68-4d46-a25a-9dc0d1fef835 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:47:06.042779 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d08af61b-9e68-4d46-a25a-9dc0d1fef835 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:47:06.050176 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d08af61b-9e68-4d46-a25a-9dc0d1fef835 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184" status: 200 len: 1452 microversion: 2.1 time: 0.150100 Jun 29 12:47:06.050761 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 485/992] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:47:05 2022] GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:47:07.663922 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-a7bc08d7-71dd-41a3-82af-db71d1097aaa req-9707ca72-4414-488c-85ff-9c1fe0d5635f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e36e163-5fb2-427e-90e6-5ceb3913a184", "tag": "47818afa-8960-424a-b97e-e65a82d72628"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:47:07.672118 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-a7bc08d7-71dd-41a3-82af-db71d1097aaa req-9707ca72-4414-488c-85ff-9c1fe0d5635f service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:47:07.672568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-a7bc08d7-71dd-41a3-82af-db71d1097aaa req-9707ca72-4414-488c-85ff-9c1fe0d5635f service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:47:07.683247 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-a7bc08d7-71dd-41a3-82af-db71d1097aaa req-9707ca72-4414-488c-85ff-9c1fe0d5635f service nova] Creating event network-changed:47818afa-8960-424a-b97e-e65a82d72628 for instance 2e36e163-5fb2-427e-90e6-5ceb3913a184 on hv-cinder-81268 Jun 29 12:47:07.688228 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-a7bc08d7-71dd-41a3-82af-db71d1097aaa req-9707ca72-4414-488c-85ff-9c1fe0d5635f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028317 Jun 29 12:47:07.688809 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 508/993] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:48:33.871183 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 12:48:33.871863 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Wed Jun 29 12:48:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 12:48:35.192127 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 12:48:35.192689 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Wed Jun 29 12:48:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 12:49:02.842069 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:49:02.842836 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=46 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:49:02.847211 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-63854c07-5c19-4424-a2f1-9c32fbafaef4 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:49:02.847791 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-63854c07-5c19-4424-a2f1-9c32fbafaef4 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 2e36e163-5fb2-427e-90e6-5ceb3913a184] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:49:02.855506 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-63854c07-5c19-4424-a2f1-9c32fbafaef4 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:02.856113 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-63854c07-5c19-4424-a2f1-9c32fbafaef4 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:02.856872 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-63854c07-5c19-4424-a2f1-9c32fbafaef4 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:02.857306 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-63854c07-5c19-4424-a2f1-9c32fbafaef4 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:02.885965 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-63854c07-5c19-4424-a2f1-9c32fbafaef4 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 2e36e163-5fb2-427e-90e6-5ceb3913a184] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 12:49:02.960324 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-63854c07-5c19-4424-a2f1-9c32fbafaef4 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184" status: 204 len: 0 microversion: 2.1 time: 0.119765 Jun 29 12:49:02.960913 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 486/994] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:49:02 2022] DELETE /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 12:49:02.967761 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fe803b9d-07e0-479f-82cf-5b3e92bcc69e] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 29 12:49:02.968373 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=20 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:49:02.969092 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=40 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:49:02.973516 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-94100b5f-ea83-4548-86f9-c288c154c3e8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:49:02.974204 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-94100b5f-ea83-4548-86f9-c288c154c3e8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 2e36e163-5fb2-427e-90e6-5ceb3913a184] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:49:02.981255 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-94100b5f-ea83-4548-86f9-c288c154c3e8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:02.981697 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-94100b5f-ea83-4548-86f9-c288c154c3e8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:02.982460 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-94100b5f-ea83-4548-86f9-c288c154c3e8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:02.982893 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-94100b5f-ea83-4548-86f9-c288c154c3e8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:03.168720 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-94100b5f-ea83-4548-86f9-c288c154c3e8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:49:03.176224 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-94100b5f-ea83-4548-86f9-c288c154c3e8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184" status: 200 len: 1576 microversion: 2.1 time: 0.210214 Jun 29 12:49:03.176772 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 509/995] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:49:02 2022] GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184 => generated 1576 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:49:04.193958 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-994cc860-ad3b-41b2-bfdf-4c104650ec08 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:49:04.194680 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-994cc860-ad3b-41b2-bfdf-4c104650ec08 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 2e36e163-5fb2-427e-90e6-5ceb3913a184] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:49:04.201405 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-994cc860-ad3b-41b2-bfdf-4c104650ec08 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:04.201848 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-994cc860-ad3b-41b2-bfdf-4c104650ec08 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:04.202632 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-994cc860-ad3b-41b2-bfdf-4c104650ec08 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:04.203067 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-994cc860-ad3b-41b2-bfdf-4c104650ec08 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:04.388151 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-994cc860-ad3b-41b2-bfdf-4c104650ec08 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:49:04.395620 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-994cc860-ad3b-41b2-bfdf-4c104650ec08 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184" status: 200 len: 1576 microversion: 2.1 time: 0.205984 Jun 29 12:49:04.396170 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 487/996] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:49:04 2022] GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184 => generated 1576 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:49:05.236687 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-3a1a2aa5-4459-404d-a5de-79b03ac40b88 req-1cfb613f-b6cc-4971-8366-d5205356b749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e36e163-5fb2-427e-90e6-5ceb3913a184", "name": "network-vif-deleted", "tag": "47818afa-8960-424a-b97e-e65a82d72628"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:49:05.259703 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO oslo.messaging._drivers.impl_rabbit [-] [fe803b9d-07e0-479f-82cf-5b3e92bcc69e] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 44754. Jun 29 12:49:05.267447 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-3a1a2aa5-4459-404d-a5de-79b03ac40b88 req-1cfb613f-b6cc-4971-8366-d5205356b749 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:05.267893 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-3a1a2aa5-4459-404d-a5de-79b03ac40b88 req-1cfb613f-b6cc-4971-8366-d5205356b749 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:05.283498 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-3a1a2aa5-4459-404d-a5de-79b03ac40b88 req-1cfb613f-b6cc-4971-8366-d5205356b749 service nova] Creating event network-vif-deleted:47818afa-8960-424a-b97e-e65a82d72628 for instance 2e36e163-5fb2-427e-90e6-5ceb3913a184 on hv-cinder-81268 Jun 29 12:49:05.290132 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-3a1a2aa5-4459-404d-a5de-79b03ac40b88 req-1cfb613f-b6cc-4971-8366-d5205356b749 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056370 Jun 29 12:49:05.292083 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 510/997] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:49:05.413034 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5c17cfcc-38d3-47ab-bd97-8e8db75efd8d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:49:05.413643 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5c17cfcc-38d3-47ab-bd97-8e8db75efd8d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 2e36e163-5fb2-427e-90e6-5ceb3913a184] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:49:05.420446 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5c17cfcc-38d3-47ab-bd97-8e8db75efd8d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:05.421285 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5c17cfcc-38d3-47ab-bd97-8e8db75efd8d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:05.422135 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5c17cfcc-38d3-47ab-bd97-8e8db75efd8d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:05.422677 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5c17cfcc-38d3-47ab-bd97-8e8db75efd8d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:05.490976 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5c17cfcc-38d3-47ab-bd97-8e8db75efd8d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:49:05.500843 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5c17cfcc-38d3-47ab-bd97-8e8db75efd8d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184" status: 200 len: 1224 microversion: 2.1 time: 0.091567 Jun 29 12:49:05.501509 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 488/998] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:49:05 2022] GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:49:06.518148 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-dab33e4d-b506-46d9-9fed-96366971e668 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:49:06.518866 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-dab33e4d-b506-46d9-9fed-96366971e668 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 2e36e163-5fb2-427e-90e6-5ceb3913a184] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:49:06.526500 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dab33e4d-b506-46d9-9fed-96366971e668 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:06.526963 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dab33e4d-b506-46d9-9fed-96366971e668 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:06.527724 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dab33e4d-b506-46d9-9fed-96366971e668 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:06.528153 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-dab33e4d-b506-46d9-9fed-96366971e668 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:06.541840 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-dab33e4d-b506-46d9-9fed-96366971e668 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] HTTP exception thrown: Instance 2e36e163-5fb2-427e-90e6-5ceb3913a184 could not be found. Jun 29 12:49:06.543501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-dab33e4d-b506-46d9-9fed-96366971e668 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Request method failure captured: Jun 29 12:49:06.543501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184 HTTP/1.1 Jun 29 12:49:06.543501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:49:06.543501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:49:06.543501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:49:06.543501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:49:06.543501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:49:06.543501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:49:06.543501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:49:06.543501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:49:06.543501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEmkbmuk17l2hnGuWIasGTUauvZ1FDJ-rzWuFjKCy20tgkVCdORYXj4JNsIz6ubzAu6jaKRw97H3uUm06iybkSe-xi2Y6s4bPnFDU-hKVugVbNeapOAbMVbbNA9kAP1taoc0ZpT4IQuEldvzU3Ie4skurV5H8vjhs82Z0-P7Zavidkk Jun 29 12:49:06.543501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:49:06.543501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:49:06.543501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:49:06.543501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:49:06.543501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:49:06.543501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:49:06.543501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: 5c3c5d6a04e74a23984b32760c5b1e87 Jun 29 12:49:06.543501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-TestVolumeBootPattern-1219681393 Jun 29 12:49:06.543501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:49:06.543501 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:49:06.545246 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5c3c5d6a04e74a23984b32760c5b1e87", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5c3c5d6a04e74a23984b32760c5b1e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c3c5d6a04e74a23984b32760c5b1e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c3c5d6a04e74a23984b32760c5b1e87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:49:06.545246 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-TestVolumeBootPattern-1219681393 Jun 29 12:49:06.545246 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 5c3c5d6a04e74a23984b32760c5b1e87 Jun 29 12:49:06.545246 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-TestVolumeBootPattern-1219681393 Jun 29 12:49:06.545246 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-TestVolumeBootPattern-1219681393-project Jun 29 12:49:06.545246 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:49:06.545246 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:49:06.545246 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: b08abc69fc8e46cea2831101e8d5db87 Jun 29 12:49:06.545246 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-TestVolumeBootPattern-1219681393-project Jun 29 12:49:06.545246 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:49:06.545246 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Instance 2e36e163-5fb2-427e-90e6-5ceb3913a184 could not be found. Jun 29 12:49:06.545246 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': '2e36e163-5fb2-427e-90e6-5ceb3913a184'} Jun 29 12:49:06.546489 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:49:06.546489 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:49:06.546489 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:49:06.546489 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:49:06.546489 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:49:06.546489 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:49:06.546489 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:49:06.546489 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:49:06.546489 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:49:06.546489 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:49:06.546489 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e36e163-5fb2-427e-90e6-5ceb3913a184 could not be found. Jun 29 12:49:06.546489 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:49:06.546489 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:49:06.546489 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:49:06.546489 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:49:06.546489 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:49:06.546489 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:49:06.546489 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:49:06.546489 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:49:06.546489 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:49:06.548135 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:49:06.548135 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:49:06.548135 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:49:06.548135 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:49:06.548135 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:49:06.548135 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:49:06.548135 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:49:06.548135 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e36e163-5fb2-427e-90e6-5ceb3913a184 could not be found. Jun 29 12:49:06.548135 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:49:06.548135 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:49:06.548135 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:49:06.548135 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:49:06.548135 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:49:06.548135 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:49:06.548135 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:49:06.548135 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:49:06.548135 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e36e163-5fb2-427e-90e6-5ceb3913a184 could not be found. Jun 29 12:49:06.548135 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:49:06.549592 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-dab33e4d-b506-46d9-9fed-96366971e668 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Returning 404 to user: Instance 2e36e163-5fb2-427e-90e6-5ceb3913a184 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:49:06.549592 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-dab33e4d-b506-46d9-9fed-96366971e668 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184" status: 404 len: 111 microversion: 2.1 time: 0.030962 Jun 29 12:49:06.549592 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 511/999] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:49:06 2022] GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:49:06.591035 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-742f9516-0b96-4472-87bc-2bf8e0e49019 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-569018573", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-260463289", "security_groups": [{"name": "tempest-secgroup-smoke-1541791989"}], "block_device_mapping_v2": [{"uuid": "2bb71491-c0c7-481f-b744-09bddf5a4f1b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "78656dd4-2a18-4c61-b4c7-5f35673ea9fe"}]}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:49:06.707931 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.network.neutron [None req-742f9516-0b96-4472-87bc-2bf8e0e49019 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] validate_networks() for [('78656dd4-2a18-4c61-b4c7-5f35673ea9fe', None, None, None, None, None)] {{(pid=124316) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 12:49:07.067970 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-742f9516-0b96-4472-87bc-2bf8e0e49019 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Flavor limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 12:49:07.068391 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-742f9516-0b96-4472-87bc-2bf8e0e49019 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Image limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 12:49:07.068863 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-742f9516-0b96-4472-87bc-2bf8e0e49019 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Flavor pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 12:49:07.069267 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-742f9516-0b96-4472-87bc-2bf8e0e49019 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Image pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 12:49:07.069727 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-742f9516-0b96-4472-87bc-2bf8e0e49019 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 12:49:07.079144 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-742f9516-0b96-4472-87bc-2bf8e0e49019 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:07.079590 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-742f9516-0b96-4472-87bc-2bf8e0e49019 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:07.080402 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-742f9516-0b96-4472-87bc-2bf8e0e49019 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:07.080833 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-742f9516-0b96-4472-87bc-2bf8e0e49019 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:07.096946 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-742f9516-0b96-4472-87bc-2bf8e0e49019 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Getting quotas for project 5c3c5d6a04e74a23984b32760c5b1e87. Resources: {'cores', 'ram', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:49:07.101034 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-742f9516-0b96-4472-87bc-2bf8e0e49019 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Getting quotas for user b08abc69fc8e46cea2831101e8d5db87 and project 5c3c5d6a04e74a23984b32760c5b1e87. Resources: {'cores', 'ram', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:49:07.160852 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-742f9516-0b96-4472-87bc-2bf8e0e49019 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Going to run 1 instances... {{(pid=124316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 12:49:07.162947 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-742f9516-0b96-4472-87bc-2bf8e0e49019 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2bb71491-c0c7-481f-b744-09bddf5a4f1b',volume_size=None,volume_type=None)] {{(pid=124316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 12:49:07.288142 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-742f9516-0b96-4472-87bc-2bf8e0e49019 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.700925 Jun 29 12:49:07.288781 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 489/1000] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 12:49:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 12:49:07.298799 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-e5b21c0d-c234-491a-8de9-c645eb27c0f7 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:49:07.299408 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-e5b21c0d-c234-491a-8de9-c645eb27c0f7 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:49:07.353496 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-e5b21c0d-c234-491a-8de9-c645eb27c0f7 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:49:07.360675 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-e5b21c0d-c234-491a-8de9-c645eb27c0f7 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0" status: 200 len: 1093 microversion: 2.1 time: 0.065894 Jun 29 12:49:07.361634 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 512/1001] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:49:07 2022] GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:49:08.379065 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-ff525b73-91c2-4543-b794-8d353986d430 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:49:08.379602 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-ff525b73-91c2-4543-b794-8d353986d430 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:49:08.386053 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ff525b73-91c2-4543-b794-8d353986d430 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:08.386542 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ff525b73-91c2-4543-b794-8d353986d430 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:08.387311 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ff525b73-91c2-4543-b794-8d353986d430 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:08.387752 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-ff525b73-91c2-4543-b794-8d353986d430 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:08.460297 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-ff525b73-91c2-4543-b794-8d353986d430 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:49:08.468191 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-ff525b73-91c2-4543-b794-8d353986d430 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0" status: 200 len: 1209 microversion: 2.1 time: 0.093542 Jun 29 12:49:08.468753 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 490/1002] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:49:08 2022] GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 => generated 1209 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:49:09.486957 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-3e3ae067-f1b4-454c-9bdd-81a2e5d45bf1 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:49:09.487429 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-3e3ae067-f1b4-454c-9bdd-81a2e5d45bf1 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:49:09.495519 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3e3ae067-f1b4-454c-9bdd-81a2e5d45bf1 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:09.495979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3e3ae067-f1b4-454c-9bdd-81a2e5d45bf1 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:09.496753 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3e3ae067-f1b4-454c-9bdd-81a2e5d45bf1 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:09.497193 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-3e3ae067-f1b4-454c-9bdd-81a2e5d45bf1 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:09.545262 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [req-08fd711e-fa9d-48f4-ad11-7a7020912e1b req-5bf641b6-a89c-40f0-8dcb-2ef601eae11e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0", "tag": "5f4d9ef9-ce53-4c5e-9115-708ee3e03107"}]} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:49:09.556170 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-08fd711e-fa9d-48f4-ad11-7a7020912e1b req-5bf641b6-a89c-40f0-8dcb-2ef601eae11e service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:09.556606 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [req-08fd711e-fa9d-48f4-ad11-7a7020912e1b req-5bf641b6-a89c-40f0-8dcb-2ef601eae11e service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:09.568746 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.compute.server_external_events [req-08fd711e-fa9d-48f4-ad11-7a7020912e1b req-5bf641b6-a89c-40f0-8dcb-2ef601eae11e service nova] Creating event network-changed:5f4d9ef9-ce53-4c5e-9115-708ee3e03107 for instance 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 on hv-cinder-81268 Jun 29 12:49:09.573874 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [req-08fd711e-fa9d-48f4-ad11-7a7020912e1b req-5bf641b6-a89c-40f0-8dcb-2ef601eae11e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034205 Jun 29 12:49:09.575165 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 491/1003] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:49:09.665505 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-3e3ae067-f1b4-454c-9bdd-81a2e5d45bf1 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:49:09.673554 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-3e3ae067-f1b4-454c-9bdd-81a2e5d45bf1 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0" status: 200 len: 1265 microversion: 2.1 time: 0.192076 Jun 29 12:49:09.674136 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 513/1004] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:49:09 2022] GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:49:10.691730 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-20b53d65-e665-4c7a-94c2-8093e2b5694b tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:49:10.692455 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-20b53d65-e665-4c7a-94c2-8093e2b5694b tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:49:10.699405 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-20b53d65-e665-4c7a-94c2-8093e2b5694b tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:10.699865 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-20b53d65-e665-4c7a-94c2-8093e2b5694b tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:10.700646 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-20b53d65-e665-4c7a-94c2-8093e2b5694b tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:10.701090 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-20b53d65-e665-4c7a-94c2-8093e2b5694b tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:10.832567 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-20b53d65-e665-4c7a-94c2-8093e2b5694b tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:49:10.840183 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-20b53d65-e665-4c7a-94c2-8093e2b5694b tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0" status: 200 len: 1265 microversion: 2.1 time: 0.153162 Jun 29 12:49:10.840751 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 492/1005] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:49:10 2022] GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:49:11.856299 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-09426362-6f2c-490b-a4b1-fadcc96b3383 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:49:11.856912 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-09426362-6f2c-490b-a4b1-fadcc96b3383 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:49:11.863344 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-09426362-6f2c-490b-a4b1-fadcc96b3383 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:11.863787 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-09426362-6f2c-490b-a4b1-fadcc96b3383 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:11.864538 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-09426362-6f2c-490b-a4b1-fadcc96b3383 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:11.864965 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-09426362-6f2c-490b-a4b1-fadcc96b3383 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:11.996529 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-09426362-6f2c-490b-a4b1-fadcc96b3383 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:49:12.003870 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-09426362-6f2c-490b-a4b1-fadcc96b3383 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0" status: 200 len: 1265 microversion: 2.1 time: 0.151732 Jun 29 12:49:12.004426 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 514/1006] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:49:11 2022] GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:49:13.021012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-49e9fc3d-dbef-4cda-ab59-97d439dca3d3 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:49:13.021657 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-49e9fc3d-dbef-4cda-ab59-97d439dca3d3 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:49:13.029167 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-49e9fc3d-dbef-4cda-ab59-97d439dca3d3 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:13.029632 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-49e9fc3d-dbef-4cda-ab59-97d439dca3d3 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:13.030388 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-49e9fc3d-dbef-4cda-ab59-97d439dca3d3 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:13.030850 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-49e9fc3d-dbef-4cda-ab59-97d439dca3d3 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:13.156456 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-49e9fc3d-dbef-4cda-ab59-97d439dca3d3 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:49:13.163842 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-49e9fc3d-dbef-4cda-ab59-97d439dca3d3 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0" status: 200 len: 1265 microversion: 2.1 time: 0.146682 Jun 29 12:49:13.164397 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 493/1007] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:49:13 2022] GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:49:14.181329 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f645de72-ee03-4199-ab96-2833ee26504e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:49:14.181960 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f645de72-ee03-4199-ab96-2833ee26504e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:49:14.188438 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f645de72-ee03-4199-ab96-2833ee26504e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:14.188881 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f645de72-ee03-4199-ab96-2833ee26504e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:14.189625 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f645de72-ee03-4199-ab96-2833ee26504e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:14.190056 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f645de72-ee03-4199-ab96-2833ee26504e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:14.324398 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f645de72-ee03-4199-ab96-2833ee26504e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:49:14.331729 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f645de72-ee03-4199-ab96-2833ee26504e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0" status: 200 len: 1265 microversion: 2.1 time: 0.154886 Jun 29 12:49:14.332275 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 515/1008] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:49:14 2022] GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:49:15.348644 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-0d4f8052-53d6-416d-8e48-e3c816747f50 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:49:15.349180 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-0d4f8052-53d6-416d-8e48-e3c816747f50 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:49:15.356274 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0d4f8052-53d6-416d-8e48-e3c816747f50 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:15.356731 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0d4f8052-53d6-416d-8e48-e3c816747f50 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:15.357493 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0d4f8052-53d6-416d-8e48-e3c816747f50 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:15.357932 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-0d4f8052-53d6-416d-8e48-e3c816747f50 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:15.488529 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-0d4f8052-53d6-416d-8e48-e3c816747f50 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:49:15.496637 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-0d4f8052-53d6-416d-8e48-e3c816747f50 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0" status: 200 len: 1265 microversion: 2.1 time: 0.151940 Jun 29 12:49:15.497199 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 494/1009] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:49:15 2022] GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:49:16.513176 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-ad76286a-5f72-4cd0-889f-ee2625b06572 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:49:16.513764 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-ad76286a-5f72-4cd0-889f-ee2625b06572 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:49:16.520508 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ad76286a-5f72-4cd0-889f-ee2625b06572 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:16.520952 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ad76286a-5f72-4cd0-889f-ee2625b06572 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:16.521709 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ad76286a-5f72-4cd0-889f-ee2625b06572 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:16.522138 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-ad76286a-5f72-4cd0-889f-ee2625b06572 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:16.657511 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-ad76286a-5f72-4cd0-889f-ee2625b06572 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:49:16.665596 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-ad76286a-5f72-4cd0-889f-ee2625b06572 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0" status: 200 len: 1265 microversion: 2.1 time: 0.156340 Jun 29 12:49:16.666147 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 516/1010] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:49:16 2022] GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:49:17.683363 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-d606952f-8dfa-4df7-8f6c-1e63f47f1ff2 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:49:17.684004 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-d606952f-8dfa-4df7-8f6c-1e63f47f1ff2 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:49:17.686383 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:49:17.687053 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=6 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:49:17.692875 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d606952f-8dfa-4df7-8f6c-1e63f47f1ff2 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:17.693321 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d606952f-8dfa-4df7-8f6c-1e63f47f1ff2 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:17.694072 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d606952f-8dfa-4df7-8f6c-1e63f47f1ff2 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:17.694531 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-d606952f-8dfa-4df7-8f6c-1e63f47f1ff2 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:17.823802 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-d606952f-8dfa-4df7-8f6c-1e63f47f1ff2 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:49:17.831210 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-d606952f-8dfa-4df7-8f6c-1e63f47f1ff2 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0" status: 200 len: 1265 microversion: 2.1 time: 0.152710 Jun 29 12:49:17.831766 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 495/1011] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:49:17 2022] GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:49:18.194130 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-64f3c632-d440-49ce-8ca2-8c9a5e474029 req-ef83a846-76a2-43c3-b12b-d889f9565f1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0", "name": "network-vif-plugged", "status": "completed", "tag": "5f4d9ef9-ce53-4c5e-9115-708ee3e03107"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:49:18.198915 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=2 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:49:18.204990 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-64f3c632-d440-49ce-8ca2-8c9a5e474029 req-ef83a846-76a2-43c3-b12b-d889f9565f1b service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:18.205441 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-64f3c632-d440-49ce-8ca2-8c9a5e474029 req-ef83a846-76a2-43c3-b12b-d889f9565f1b service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:18.217212 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-64f3c632-d440-49ce-8ca2-8c9a5e474029 req-ef83a846-76a2-43c3-b12b-d889f9565f1b service nova] Creating event network-vif-plugged:5f4d9ef9-ce53-4c5e-9115-708ee3e03107 for instance 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 on hv-cinder-81268 Jun 29 12:49:18.222147 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-64f3c632-d440-49ce-8ca2-8c9a5e474029 req-ef83a846-76a2-43c3-b12b-d889f9565f1b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032189 Jun 29 12:49:18.222766 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 517/1012] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:49:18.847950 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-b2caf245-84d7-4f26-b340-f5655b60961d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:49:18.848563 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-b2caf245-84d7-4f26-b340-f5655b60961d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:49:18.855800 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b2caf245-84d7-4f26-b340-f5655b60961d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:18.856252 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b2caf245-84d7-4f26-b340-f5655b60961d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:18.857017 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b2caf245-84d7-4f26-b340-f5655b60961d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:18.857460 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-b2caf245-84d7-4f26-b340-f5655b60961d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:18.984073 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-b2caf245-84d7-4f26-b340-f5655b60961d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:49:18.991466 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-b2caf245-84d7-4f26-b340-f5655b60961d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0" status: 200 len: 1265 microversion: 2.1 time: 0.147480 Jun 29 12:49:18.992051 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 496/1013] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:49:18 2022] GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:49:20.009946 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-73fe6490-d291-48c4-942e-581ce1883fd0 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:49:20.010662 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-73fe6490-d291-48c4-942e-581ce1883fd0 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:49:20.016785 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-73fe6490-d291-48c4-942e-581ce1883fd0 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:20.017224 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-73fe6490-d291-48c4-942e-581ce1883fd0 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:20.017971 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-73fe6490-d291-48c4-942e-581ce1883fd0 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:20.018401 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-73fe6490-d291-48c4-942e-581ce1883fd0 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:20.152617 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-73fe6490-d291-48c4-942e-581ce1883fd0 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:49:20.159979 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-73fe6490-d291-48c4-942e-581ce1883fd0 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0" status: 200 len: 1453 microversion: 2.1 time: 0.155258 Jun 29 12:49:20.160533 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 518/1014] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:49:20 2022] GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:49:20.176573 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5f6d3606-b75f-4394-9778-76d293a8af3c tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:49:20.177182 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5f6d3606-b75f-4394-9778-76d293a8af3c tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:49:20.183364 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5f6d3606-b75f-4394-9778-76d293a8af3c tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:20.183834 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5f6d3606-b75f-4394-9778-76d293a8af3c tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:20.184586 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5f6d3606-b75f-4394-9778-76d293a8af3c tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:20.185016 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5f6d3606-b75f-4394-9778-76d293a8af3c tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:20.313335 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5f6d3606-b75f-4394-9778-76d293a8af3c tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:49:20.321558 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5f6d3606-b75f-4394-9778-76d293a8af3c tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0" status: 200 len: 1453 microversion: 2.1 time: 0.148247 Jun 29 12:49:20.322127 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 497/1015] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:49:20 2022] GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 12:49:22.151984 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-3a140e26-6867-45d8-a258-21505aca9fdf req-1b1e9ddf-40bb-486f-baef-f2bb714eddb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0", "tag": "5f4d9ef9-ce53-4c5e-9115-708ee3e03107"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:49:22.160965 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-3a140e26-6867-45d8-a258-21505aca9fdf req-1b1e9ddf-40bb-486f-baef-f2bb714eddb3 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:49:22.161407 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-3a140e26-6867-45d8-a258-21505aca9fdf req-1b1e9ddf-40bb-486f-baef-f2bb714eddb3 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:49:22.172527 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-3a140e26-6867-45d8-a258-21505aca9fdf req-1b1e9ddf-40bb-486f-baef-f2bb714eddb3 service nova] Creating event network-changed:5f4d9ef9-ce53-4c5e-9115-708ee3e03107 for instance 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 on hv-cinder-81268 Jun 29 12:49:22.177602 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-3a140e26-6867-45d8-a258-21505aca9fdf req-1b1e9ddf-40bb-486f-baef-f2bb714eddb3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030215 Jun 29 12:49:22.178366 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 519/1016] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 12:50:55.167865 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:50:55.168608 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:50:55.172515 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-eba4d43d-ea4c-4611-933b-4f33d4f02d0e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1706632058", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-260463289", "security_groups": [{"name": "tempest-secgroup-smoke-1541791989"}], "block_device_mapping_v2": [{"uuid": "29f08e48-fbed-4a24-acbc-ae8ee0fb3ef6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "78656dd4-2a18-4c61-b4c7-5f35673ea9fe"}]}} {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:50:55.287922 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.network.neutron [None req-eba4d43d-ea4c-4611-933b-4f33d4f02d0e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] validate_networks() for [('78656dd4-2a18-4c61-b4c7-5f35673ea9fe', None, None, None, None, None)] {{(pid=124316) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 12:50:55.655973 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-eba4d43d-ea4c-4611-933b-4f33d4f02d0e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Flavor limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 12:50:55.656411 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-eba4d43d-ea4c-4611-933b-4f33d4f02d0e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Image limits 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 12:50:55.656886 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-eba4d43d-ea4c-4611-933b-4f33d4f02d0e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Flavor pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 12:50:55.657300 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-eba4d43d-ea4c-4611-933b-4f33d4f02d0e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Image pref 0:0:0 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 12:50:55.657715 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.virt.hardware [None req-eba4d43d-ea4c-4611-933b-4f33d4f02d0e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124316) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 12:50:55.666659 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eba4d43d-ea4c-4611-933b-4f33d4f02d0e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:50:55.667110 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eba4d43d-ea4c-4611-933b-4f33d4f02d0e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:50:55.667909 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eba4d43d-ea4c-4611-933b-4f33d4f02d0e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:50:55.668349 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eba4d43d-ea4c-4611-933b-4f33d4f02d0e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:50:55.686238 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-eba4d43d-ea4c-4611-933b-4f33d4f02d0e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Getting quotas for project 5c3c5d6a04e74a23984b32760c5b1e87. Resources: {'cores', 'ram', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 12:50:55.690943 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.quota [None req-eba4d43d-ea4c-4611-933b-4f33d4f02d0e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Getting quotas for user b08abc69fc8e46cea2831101e8d5db87 and project 5c3c5d6a04e74a23984b32760c5b1e87. Resources: {'cores', 'ram', 'instances'} {{(pid=124316) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 12:50:55.750445 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-eba4d43d-ea4c-4611-933b-4f33d4f02d0e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Going to run 1 instances... {{(pid=124316) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 12:50:55.753226 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-eba4d43d-ea4c-4611-933b-4f33d4f02d0e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='29f08e48-fbed-4a24-acbc-ae8ee0fb3ef6',volume_size=None,volume_type=None)] {{(pid=124316) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 12:50:55.877167 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-eba4d43d-ea4c-4611-933b-4f33d4f02d0e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.710945 Jun 29 12:50:55.878845 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 498/1017] 10.222.0.52 () {60 vars in 1146 bytes} [Wed Jun 29 12:50:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 12:50:55.887187 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=24 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:50:55.887930 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=44 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:50:55.891899 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-5d0fabbb-7235-4df5-b544-21aef108d446 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:50:55.892596 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-5d0fabbb-7235-4df5-b544-21aef108d446 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:50:55.948547 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-5d0fabbb-7235-4df5-b544-21aef108d446 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:50:55.955250 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-5d0fabbb-7235-4df5-b544-21aef108d446 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7" status: 200 len: 1094 microversion: 2.1 time: 0.070147 Jun 29 12:50:55.956067 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 520/1018] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:50:55 2022] GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:50:56.974221 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-cde4b7be-8a27-4540-99cf-7c97672496f3 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:50:56.974871 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-cde4b7be-8a27-4540-99cf-7c97672496f3 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:50:57.033111 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-cde4b7be-8a27-4540-99cf-7c97672496f3 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:50:57.041506 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-cde4b7be-8a27-4540-99cf-7c97672496f3 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7" status: 200 len: 1094 microversion: 2.1 time: 0.072712 Jun 29 12:50:57.042048 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 499/1019] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:50:56 2022] GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:50:58.059422 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-4c9d0926-4061-4dcc-8ffc-a61d781bbc17 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:50:58.060253 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-4c9d0926-4061-4dcc-8ffc-a61d781bbc17 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:50:58.115622 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-4c9d0926-4061-4dcc-8ffc-a61d781bbc17 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:50:58.122179 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-4c9d0926-4061-4dcc-8ffc-a61d781bbc17 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7" status: 200 len: 1094 microversion: 2.1 time: 0.066741 Jun 29 12:50:58.122952 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 521/1020] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:50:58 2022] GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:50:59.139979 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-9766bc2a-e0e7-43eb-9562-b8b8a9b75511 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:50:59.140616 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-9766bc2a-e0e7-43eb-9562-b8b8a9b75511 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:50:59.195093 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-9766bc2a-e0e7-43eb-9562-b8b8a9b75511 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:50:59.202014 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-9766bc2a-e0e7-43eb-9562-b8b8a9b75511 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7" status: 200 len: 1094 microversion: 2.1 time: 0.065902 Jun 29 12:50:59.202618 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 500/1021] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:50:59 2022] GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:51:00.219359 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-bc50c392-8a1a-4c13-9458-48b06079f8e8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:51:00.219953 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-bc50c392-8a1a-4c13-9458-48b06079f8e8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:51:00.227273 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bc50c392-8a1a-4c13-9458-48b06079f8e8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:00.227721 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bc50c392-8a1a-4c13-9458-48b06079f8e8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:00.228479 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bc50c392-8a1a-4c13-9458-48b06079f8e8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:00.228912 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-bc50c392-8a1a-4c13-9458-48b06079f8e8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:00.294820 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-bc50c392-8a1a-4c13-9458-48b06079f8e8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:51:00.302296 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-bc50c392-8a1a-4c13-9458-48b06079f8e8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7" status: 200 len: 1144 microversion: 2.1 time: 0.086815 Jun 29 12:51:00.302882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 522/1022] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:51:00 2022] GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:51:01.320767 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4d664d91-2064-44c0-8073-0cc65e607415 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:51:01.322678 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4d664d91-2064-44c0-8073-0cc65e607415 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:51:01.330676 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4d664d91-2064-44c0-8073-0cc65e607415 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:01.331821 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4d664d91-2064-44c0-8073-0cc65e607415 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:01.332614 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4d664d91-2064-44c0-8073-0cc65e607415 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:01.333060 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4d664d91-2064-44c0-8073-0cc65e607415 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:01.405942 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-4d664d91-2064-44c0-8073-0cc65e607415 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:51:01.415440 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4d664d91-2064-44c0-8073-0cc65e607415 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7" status: 200 len: 1210 microversion: 2.1 time: 0.100090 Jun 29 12:51:01.416334 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 501/1023] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:51:01 2022] GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 => generated 1210 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:51:02.279992 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-874c9fb1-ce41-40f1-9cb2-7d058c364e9d req-68649e79-4453-407b-8422-14b01690012a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7", "tag": "599b4659-f605-4280-aa40-1ff6c04e0725"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:51:02.289300 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-874c9fb1-ce41-40f1-9cb2-7d058c364e9d req-68649e79-4453-407b-8422-14b01690012a service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:02.289812 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-874c9fb1-ce41-40f1-9cb2-7d058c364e9d req-68649e79-4453-407b-8422-14b01690012a service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:02.303424 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-874c9fb1-ce41-40f1-9cb2-7d058c364e9d req-68649e79-4453-407b-8422-14b01690012a service nova] Creating event network-changed:599b4659-f605-4280-aa40-1ff6c04e0725 for instance a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 on hv-cinder-81268 Jun 29 12:51:02.309212 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-874c9fb1-ce41-40f1-9cb2-7d058c364e9d req-68649e79-4453-407b-8422-14b01690012a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109578 Jun 29 12:51:02.309981 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 523/1024] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:51:02.434763 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-618ee9b1-2d90-4533-9d82-66a28dc50d3f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:51:02.435311 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-618ee9b1-2d90-4533-9d82-66a28dc50d3f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:51:02.442450 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-618ee9b1-2d90-4533-9d82-66a28dc50d3f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:02.442922 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-618ee9b1-2d90-4533-9d82-66a28dc50d3f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:02.443699 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-618ee9b1-2d90-4533-9d82-66a28dc50d3f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:02.444134 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-618ee9b1-2d90-4533-9d82-66a28dc50d3f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:02.929339 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-618ee9b1-2d90-4533-9d82-66a28dc50d3f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:51:02.936895 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-618ee9b1-2d90-4533-9d82-66a28dc50d3f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7" status: 200 len: 1266 microversion: 2.1 time: 0.506060 Jun 29 12:51:02.937520 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 502/1025] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:51:02 2022] GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 => generated 1266 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:51:03.955920 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-8bce9120-bddb-4905-9e70-1cb2724e97a8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:51:03.956550 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-8bce9120-bddb-4905-9e70-1cb2724e97a8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:51:03.962766 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8bce9120-bddb-4905-9e70-1cb2724e97a8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:03.963218 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8bce9120-bddb-4905-9e70-1cb2724e97a8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:03.963985 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8bce9120-bddb-4905-9e70-1cb2724e97a8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:03.964528 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-8bce9120-bddb-4905-9e70-1cb2724e97a8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:04.098909 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-8bce9120-bddb-4905-9e70-1cb2724e97a8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:51:04.106268 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-8bce9120-bddb-4905-9e70-1cb2724e97a8 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7" status: 200 len: 1266 microversion: 2.1 time: 0.155126 Jun 29 12:51:04.106853 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 524/1026] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:51:03 2022] GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:51:05.123569 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8df7b037-3c59-4893-8ffe-4a6cd39b121e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:51:05.124180 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8df7b037-3c59-4893-8ffe-4a6cd39b121e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:51:05.131408 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8df7b037-3c59-4893-8ffe-4a6cd39b121e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:05.131856 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8df7b037-3c59-4893-8ffe-4a6cd39b121e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:05.132609 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8df7b037-3c59-4893-8ffe-4a6cd39b121e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:05.133043 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8df7b037-3c59-4893-8ffe-4a6cd39b121e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:05.266385 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8df7b037-3c59-4893-8ffe-4a6cd39b121e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:51:05.274830 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8df7b037-3c59-4893-8ffe-4a6cd39b121e tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7" status: 200 len: 1266 microversion: 2.1 time: 0.155062 Jun 29 12:51:05.275383 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 503/1027] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:51:05 2022] GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:51:06.291897 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d98165af-9e8e-4f35-94d5-d17f7d623962 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:51:06.292511 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d98165af-9e8e-4f35-94d5-d17f7d623962 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:51:06.298714 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d98165af-9e8e-4f35-94d5-d17f7d623962 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:06.299166 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d98165af-9e8e-4f35-94d5-d17f7d623962 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:06.300885 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d98165af-9e8e-4f35-94d5-d17f7d623962 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:06.301323 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d98165af-9e8e-4f35-94d5-d17f7d623962 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:06.430927 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d98165af-9e8e-4f35-94d5-d17f7d623962 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:51:06.438259 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d98165af-9e8e-4f35-94d5-d17f7d623962 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7" status: 200 len: 1266 microversion: 2.1 time: 0.150224 Jun 29 12:51:06.438836 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 525/1028] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:51:06 2022] GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:51:07.456204 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-f40dd5a3-fbdb-4c38-93f9-5b6fc5e81b49 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:51:07.456944 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-f40dd5a3-fbdb-4c38-93f9-5b6fc5e81b49 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:51:07.458788 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=2 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:51:07.464592 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f40dd5a3-fbdb-4c38-93f9-5b6fc5e81b49 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:07.465038 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f40dd5a3-fbdb-4c38-93f9-5b6fc5e81b49 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:07.465821 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f40dd5a3-fbdb-4c38-93f9-5b6fc5e81b49 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:07.466252 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-f40dd5a3-fbdb-4c38-93f9-5b6fc5e81b49 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:07.597748 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-f40dd5a3-fbdb-4c38-93f9-5b6fc5e81b49 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:51:07.605113 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-f40dd5a3-fbdb-4c38-93f9-5b6fc5e81b49 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7" status: 200 len: 1266 microversion: 2.1 time: 0.153387 Jun 29 12:51:07.605668 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 504/1029] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:51:07 2022] GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:51:08.621742 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0a3f3c7c-799c-42da-8e3d-d6df65583c44 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:51:08.622292 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0a3f3c7c-799c-42da-8e3d-d6df65583c44 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:51:08.624691 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell0:SELECT=4 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:51:08.630255 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0a3f3c7c-799c-42da-8e3d-d6df65583c44 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:08.630729 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0a3f3c7c-799c-42da-8e3d-d6df65583c44 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:08.631489 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0a3f3c7c-799c-42da-8e3d-d6df65583c44 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:08.631926 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0a3f3c7c-799c-42da-8e3d-d6df65583c44 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:08.760957 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0a3f3c7c-799c-42da-8e3d-d6df65583c44 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:51:08.768940 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0a3f3c7c-799c-42da-8e3d-d6df65583c44 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7" status: 200 len: 1266 microversion: 2.1 time: 0.150518 Jun 29 12:51:08.769503 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 526/1030] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:51:08 2022] GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:51:09.785914 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-01b65378-da26-442c-b157-ae6006c07379 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:51:09.786624 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-01b65378-da26-442c-b157-ae6006c07379 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:51:09.788891 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell0:SELECT=10 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:51:09.794473 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-01b65378-da26-442c-b157-ae6006c07379 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:09.794928 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-01b65378-da26-442c-b157-ae6006c07379 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:09.795692 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-01b65378-da26-442c-b157-ae6006c07379 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:09.796132 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-01b65378-da26-442c-b157-ae6006c07379 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:09.931756 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-01b65378-da26-442c-b157-ae6006c07379 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:51:09.939136 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-01b65378-da26-442c-b157-ae6006c07379 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7" status: 200 len: 1266 microversion: 2.1 time: 0.157180 Jun 29 12:51:09.939695 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 505/1031] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:51:09 2022] GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:51:10.957153 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-c75566cc-bf1f-4644-8c02-17e3acc7f981 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:51:10.957778 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-c75566cc-bf1f-4644-8c02-17e3acc7f981 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:51:10.964297 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c75566cc-bf1f-4644-8c02-17e3acc7f981 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:10.964750 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c75566cc-bf1f-4644-8c02-17e3acc7f981 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:10.965511 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c75566cc-bf1f-4644-8c02-17e3acc7f981 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:10.965949 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-c75566cc-bf1f-4644-8c02-17e3acc7f981 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:11.101174 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-c75566cc-bf1f-4644-8c02-17e3acc7f981 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:51:11.108821 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-c75566cc-bf1f-4644-8c02-17e3acc7f981 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7" status: 200 len: 1266 microversion: 2.1 time: 0.155801 Jun 29 12:51:11.109383 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 527/1032] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:51:10 2022] GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:51:12.126637 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-8989636e-30a0-4ff1-a938-a7f2c9d7b0dc tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:51:12.127263 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-8989636e-30a0-4ff1-a938-a7f2c9d7b0dc tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:51:12.134789 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8989636e-30a0-4ff1-a938-a7f2c9d7b0dc tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:12.135243 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8989636e-30a0-4ff1-a938-a7f2c9d7b0dc tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:12.136012 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8989636e-30a0-4ff1-a938-a7f2c9d7b0dc tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:12.136450 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-8989636e-30a0-4ff1-a938-a7f2c9d7b0dc tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:12.266619 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-8989636e-30a0-4ff1-a938-a7f2c9d7b0dc tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:51:12.274516 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-8989636e-30a0-4ff1-a938-a7f2c9d7b0dc tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7" status: 200 len: 1266 microversion: 2.1 time: 0.151759 Jun 29 12:51:12.275121 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 506/1033] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:51:12 2022] GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:51:12.909239 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-5bfa40d8-5ee6-4925-ba4d-ffc207547e9d req-f6b30435-6528-4ce6-a019-b6c3c3f51fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7", "name": "network-vif-plugged", "status": "completed", "tag": "599b4659-f605-4280-aa40-1ff6c04e0725"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:51:12.917120 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-5bfa40d8-5ee6-4925-ba4d-ffc207547e9d req-f6b30435-6528-4ce6-a019-b6c3c3f51fd6 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:12.917565 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-5bfa40d8-5ee6-4925-ba4d-ffc207547e9d req-f6b30435-6528-4ce6-a019-b6c3c3f51fd6 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:12.929043 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-5bfa40d8-5ee6-4925-ba4d-ffc207547e9d req-f6b30435-6528-4ce6-a019-b6c3c3f51fd6 service nova] Creating event network-vif-plugged:599b4659-f605-4280-aa40-1ff6c04e0725 for instance a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 on hv-cinder-81268 Jun 29 12:51:12.933866 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-5bfa40d8-5ee6-4925-ba4d-ffc207547e9d req-f6b30435-6528-4ce6-a019-b6c3c3f51fd6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087969 Jun 29 12:51:12.934457 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 528/1034] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:51:13.291737 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e5bcb8c0-ce51-4720-b098-d38bddbca311 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:51:13.292415 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e5bcb8c0-ce51-4720-b098-d38bddbca311 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:51:13.299341 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e5bcb8c0-ce51-4720-b098-d38bddbca311 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:13.301197 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e5bcb8c0-ce51-4720-b098-d38bddbca311 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:13.301964 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e5bcb8c0-ce51-4720-b098-d38bddbca311 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:13.302409 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e5bcb8c0-ce51-4720-b098-d38bddbca311 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:13.432964 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e5bcb8c0-ce51-4720-b098-d38bddbca311 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:51:13.440525 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e5bcb8c0-ce51-4720-b098-d38bddbca311 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7" status: 200 len: 1266 microversion: 2.1 time: 0.152867 Jun 29 12:51:13.441264 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 507/1035] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:51:13 2022] GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:51:14.457961 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-d565f1c3-0a3a-454b-b4d4-d05afaf69719 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:51:14.458702 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-d565f1c3-0a3a-454b-b4d4-d05afaf69719 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:51:14.466927 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d565f1c3-0a3a-454b-b4d4-d05afaf69719 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:14.467371 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d565f1c3-0a3a-454b-b4d4-d05afaf69719 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:14.468133 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d565f1c3-0a3a-454b-b4d4-d05afaf69719 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:14.468565 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-d565f1c3-0a3a-454b-b4d4-d05afaf69719 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:14.599312 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-d565f1c3-0a3a-454b-b4d4-d05afaf69719 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:51:14.606776 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-d565f1c3-0a3a-454b-b4d4-d05afaf69719 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7" status: 200 len: 1453 microversion: 2.1 time: 0.153335 Jun 29 12:51:14.607332 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 529/1036] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:51:14 2022] GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:51:14.623262 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-fc75f457-504f-438b-a8ba-99f74860c68d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:51:14.623871 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-fc75f457-504f-438b-a8ba-99f74860c68d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:51:14.631045 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fc75f457-504f-438b-a8ba-99f74860c68d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:14.631490 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fc75f457-504f-438b-a8ba-99f74860c68d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:14.632242 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fc75f457-504f-438b-a8ba-99f74860c68d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:14.632671 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-fc75f457-504f-438b-a8ba-99f74860c68d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:14.763534 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-fc75f457-504f-438b-a8ba-99f74860c68d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:51:14.771054 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-fc75f457-504f-438b-a8ba-99f74860c68d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7" status: 200 len: 1453 microversion: 2.1 time: 0.151546 Jun 29 12:51:14.771614 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 508/1037] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:51:14 2022] GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:51:16.339683 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-433d3112-84fc-4650-8caa-f08a19a70363 req-428933ae-52f2-412c-adf6-23d7b1530566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7", "tag": "599b4659-f605-4280-aa40-1ff6c04e0725"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:51:16.348651 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-433d3112-84fc-4650-8caa-f08a19a70363 req-428933ae-52f2-412c-adf6-23d7b1530566 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:51:16.349174 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-433d3112-84fc-4650-8caa-f08a19a70363 req-428933ae-52f2-412c-adf6-23d7b1530566 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:51:16.362347 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-433d3112-84fc-4650-8caa-f08a19a70363 req-428933ae-52f2-412c-adf6-23d7b1530566 service nova] Creating event network-changed:599b4659-f605-4280-aa40-1ff6c04e0725 for instance a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 on hv-cinder-81268 Jun 29 12:51:16.367814 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-433d3112-84fc-4650-8caa-f08a19a70363 req-428933ae-52f2-412c-adf6-23d7b1530566 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031751 Jun 29 12:51:16.368645 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 530/1038] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:51:43.678534 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 12:51:43.679347 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Wed Jun 29 12:51:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 12:51:53.880770 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 12:51:53.881441 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Wed Jun 29 12:51:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 12:51:55.203867 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 12:51:55.204376 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Wed Jun 29 12:51:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 12:52:10.323975 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 12:52:10.324783 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Wed Jun 29 12:52:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 12:52:47.541302 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:52:47.542715 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG dbcounter [-] [124316] Writing DB stats nova_cell1:SELECT=50 {{(pid=124316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:52:47.544187 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_api:SELECT=26 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:52:47.545568 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG dbcounter [-] [124317] Writing DB stats nova_cell1:SELECT=42 {{(pid=124317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 12:52:47.547592 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-4803dfbe-cdff-4186-9a16-534be1f4236f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:52:47.548287 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4803dfbe-cdff-4186-9a16-534be1f4236f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:52:47.550307 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-bc72428e-3276-4f7a-8b43-3e8652abae6e req-f56e0a89-d9c9-4fc1-9b2f-daf73d871964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7", "tag": "599b4659-f605-4280-aa40-1ff6c04e0725"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:52:47.557390 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4803dfbe-cdff-4186-9a16-534be1f4236f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:47.557921 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4803dfbe-cdff-4186-9a16-534be1f4236f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:47.558957 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4803dfbe-cdff-4186-9a16-534be1f4236f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:47.559392 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-4803dfbe-cdff-4186-9a16-534be1f4236f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:47.560914 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-bc72428e-3276-4f7a-8b43-3e8652abae6e req-f56e0a89-d9c9-4fc1-9b2f-daf73d871964 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:47.561562 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-bc72428e-3276-4f7a-8b43-3e8652abae6e req-f56e0a89-d9c9-4fc1-9b2f-daf73d871964 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:47.573502 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-bc72428e-3276-4f7a-8b43-3e8652abae6e req-f56e0a89-d9c9-4fc1-9b2f-daf73d871964 service nova] Creating event network-changed:599b4659-f605-4280-aa40-1ff6c04e0725 for instance a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 on hv-cinder-81268 Jun 29 12:52:47.578968 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-bc72428e-3276-4f7a-8b43-3e8652abae6e req-f56e0a89-d9c9-4fc1-9b2f-daf73d871964 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037245 Jun 29 12:52:47.579520 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 531/1039] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:52:47.593687 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-4803dfbe-cdff-4186-9a16-534be1f4236f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 12:52:47.681499 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-4803dfbe-cdff-4186-9a16-534be1f4236f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7" status: 204 len: 0 microversion: 2.1 time: 0.143026 Jun 29 12:52:47.686809 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 509/1040] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:52:47 2022] DELETE /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 12:52:47.692259 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-f9755df1-4bfd-4afb-b7f8-b076f5bfbdc9 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:52:47.693145 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-f9755df1-4bfd-4afb-b7f8-b076f5bfbdc9 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:52:47.703790 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f9755df1-4bfd-4afb-b7f8-b076f5bfbdc9 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:47.704305 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f9755df1-4bfd-4afb-b7f8-b076f5bfbdc9 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:47.705119 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f9755df1-4bfd-4afb-b7f8-b076f5bfbdc9 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:47.705555 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-f9755df1-4bfd-4afb-b7f8-b076f5bfbdc9 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:47.852507 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-f9755df1-4bfd-4afb-b7f8-b076f5bfbdc9 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:52:47.860161 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-f9755df1-4bfd-4afb-b7f8-b076f5bfbdc9 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7" status: 200 len: 1578 microversion: 2.1 time: 0.172987 Jun 29 12:52:47.860723 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 532/1041] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:52:47 2022] GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:52:48.879122 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-e5b4fb50-8efa-40a9-8dd0-d07d402718f1 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:52:48.879817 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-e5b4fb50-8efa-40a9-8dd0-d07d402718f1 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:52:48.887134 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e5b4fb50-8efa-40a9-8dd0-d07d402718f1 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:48.887578 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e5b4fb50-8efa-40a9-8dd0-d07d402718f1 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:48.888331 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e5b4fb50-8efa-40a9-8dd0-d07d402718f1 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:48.888762 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-e5b4fb50-8efa-40a9-8dd0-d07d402718f1 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:49.029954 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-e5b4fb50-8efa-40a9-8dd0-d07d402718f1 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:52:49.037408 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-e5b4fb50-8efa-40a9-8dd0-d07d402718f1 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7" status: 200 len: 1578 microversion: 2.1 time: 0.162617 Jun 29 12:52:49.038704 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 510/1042] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:52:48 2022] GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:52:49.645382 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-9adb3341-a445-4af1-bf99-d393a22c311d req-e6dcd5aa-a395-4654-a577-e8dfe37ad047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7", "name": "network-vif-deleted", "tag": "599b4659-f605-4280-aa40-1ff6c04e0725"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:52:49.655215 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-9adb3341-a445-4af1-bf99-d393a22c311d req-e6dcd5aa-a395-4654-a577-e8dfe37ad047 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:49.655665 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-9adb3341-a445-4af1-bf99-d393a22c311d req-e6dcd5aa-a395-4654-a577-e8dfe37ad047 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:49.668177 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-9adb3341-a445-4af1-bf99-d393a22c311d req-e6dcd5aa-a395-4654-a577-e8dfe37ad047 service nova] Creating event network-vif-deleted:599b4659-f605-4280-aa40-1ff6c04e0725 for instance a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 on hv-cinder-81268 Jun 29 12:52:49.673083 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-9adb3341-a445-4af1-bf99-d393a22c311d req-e6dcd5aa-a395-4654-a577-e8dfe37ad047 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031539 Jun 29 12:52:49.673666 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 533/1043] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:52:50.056195 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-276b3b0f-aed7-4902-811b-518eda35df1f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:52:50.056918 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-276b3b0f-aed7-4902-811b-518eda35df1f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:52:50.063719 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-276b3b0f-aed7-4902-811b-518eda35df1f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:50.064178 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-276b3b0f-aed7-4902-811b-518eda35df1f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:50.064957 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-276b3b0f-aed7-4902-811b-518eda35df1f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:50.065402 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-276b3b0f-aed7-4902-811b-518eda35df1f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:50.097359 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-276b3b0f-aed7-4902-811b-518eda35df1f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:50.097804 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-276b3b0f-aed7-4902-811b-518eda35df1f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:50.098250 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-276b3b0f-aed7-4902-811b-518eda35df1f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lazy-loading 'fault' on Instance uuid a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 12:52:50.138378 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-276b3b0f-aed7-4902-811b-518eda35df1f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:52:50.145806 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-276b3b0f-aed7-4902-811b-518eda35df1f tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7" status: 200 len: 1230 microversion: 2.1 time: 0.094500 Jun 29 12:52:50.146353 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 511/1044] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:52:50 2022] GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:52:51.165145 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b5630226-1dc5-4ba3-822c-db8bab8c28e7 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:52:51.165885 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-b5630226-1dc5-4ba3-822c-db8bab8c28e7 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:52:51.172209 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b5630226-1dc5-4ba3-822c-db8bab8c28e7 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:51.172657 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b5630226-1dc5-4ba3-822c-db8bab8c28e7 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:51.173420 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b5630226-1dc5-4ba3-822c-db8bab8c28e7 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:51.173857 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-b5630226-1dc5-4ba3-822c-db8bab8c28e7 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:51.188620 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-b5630226-1dc5-4ba3-822c-db8bab8c28e7 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] HTTP exception thrown: Instance a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 could not be found. Jun 29 12:52:51.190280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b5630226-1dc5-4ba3-822c-db8bab8c28e7 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Request method failure captured: Jun 29 12:52:51.190280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 HTTP/1.1 Jun 29 12:52:51.190280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:52:51.190280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:52:51.190280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:52:51.190280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:52:51.190280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:52:51.190280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:52:51.190280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:52:51.190280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:52:51.190280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEmkbmuk17l2hnGuWIasGTUauvZ1FDJ-rzWuFjKCy20tgkVCdORYXj4JNsIz6ubzAu6jaKRw97H3uUm06iybkSe-xi2Y6s4bPnFDU-hKVugVbNeapOAbMVbbNA9kAP1taoc0ZpT4IQuEldvzU3Ie4skurV5H8vjhs82Z0-P7Zavidkk Jun 29 12:52:51.190280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:52:51.190280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:52:51.190280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:52:51.190280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:52:51.190280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:52:51.190280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:52:51.190280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: 5c3c5d6a04e74a23984b32760c5b1e87 Jun 29 12:52:51.190280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-TestVolumeBootPattern-1219681393 Jun 29 12:52:51.190280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:52:51.190280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:52:51.191916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5c3c5d6a04e74a23984b32760c5b1e87", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5c3c5d6a04e74a23984b32760c5b1e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c3c5d6a04e74a23984b32760c5b1e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c3c5d6a04e74a23984b32760c5b1e87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:52:51.191916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-TestVolumeBootPattern-1219681393 Jun 29 12:52:51.191916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 5c3c5d6a04e74a23984b32760c5b1e87 Jun 29 12:52:51.191916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-TestVolumeBootPattern-1219681393 Jun 29 12:52:51.191916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-TestVolumeBootPattern-1219681393-project Jun 29 12:52:51.191916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:52:51.191916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:52:51.191916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: b08abc69fc8e46cea2831101e8d5db87 Jun 29 12:52:51.191916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-TestVolumeBootPattern-1219681393-project Jun 29 12:52:51.191916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:52:51.191916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Instance a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 could not be found. Jun 29 12:52:51.191916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': 'a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7'} Jun 29 12:52:51.193074 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:52:51.193074 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:52:51.193074 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:52:51.193074 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:52:51.193074 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:52:51.193074 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:52:51.193074 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:52:51.193074 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:52:51.193074 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:52:51.193074 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:52:51.193074 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 could not be found. Jun 29 12:52:51.193074 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:52:51.193074 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:52:51.193074 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:52:51.193074 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:52:51.193074 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:52:51.193074 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:52:51.193074 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:52:51.193074 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:52:51.193074 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:52:51.194525 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:52:51.194525 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:52:51.194525 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:52:51.194525 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:52:51.194525 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:52:51.194525 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:52:51.194525 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:52:51.194525 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 could not be found. Jun 29 12:52:51.194525 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:52:51.194525 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:52:51.194525 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:52:51.194525 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:52:51.194525 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:52:51.194525 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:52:51.194525 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:52:51.194525 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:52:51.194525 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 could not be found. Jun 29 12:52:51.194525 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:52:51.196969 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-b5630226-1dc5-4ba3-822c-db8bab8c28e7 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Returning 404 to user: Instance a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:52:51.196969 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-b5630226-1dc5-4ba3-822c-db8bab8c28e7 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7" status: 404 len: 111 microversion: 2.1 time: 0.031394 Jun 29 12:52:51.196969 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 534/1045] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:52:51 2022] GET /compute/v2.1/servers/a863ff8d-bd2a-46b3-befc-2f8a02a2a2b7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:52:54.244943 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-c718b93f-b9c0-4795-9845-7206fec28261 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:52:54.245490 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c718b93f-b9c0-4795-9845-7206fec28261 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:52:54.247190 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-83ec8892-06b1-42b3-9f4e-4523a426c13e req-7a4e66b8-2e4e-439d-983d-27f509518c6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0", "tag": "5f4d9ef9-ce53-4c5e-9115-708ee3e03107"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:52:54.252380 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c718b93f-b9c0-4795-9845-7206fec28261 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:54.252837 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c718b93f-b9c0-4795-9845-7206fec28261 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:54.253853 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c718b93f-b9c0-4795-9845-7206fec28261 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:54.254227 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-c718b93f-b9c0-4795-9845-7206fec28261 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:54.255838 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-83ec8892-06b1-42b3-9f4e-4523a426c13e req-7a4e66b8-2e4e-439d-983d-27f509518c6c service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:54.256280 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-83ec8892-06b1-42b3-9f4e-4523a426c13e req-7a4e66b8-2e4e-439d-983d-27f509518c6c service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:54.269090 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-83ec8892-06b1-42b3-9f4e-4523a426c13e req-7a4e66b8-2e4e-439d-983d-27f509518c6c service nova] Creating event network-changed:5f4d9ef9-ce53-4c5e-9115-708ee3e03107 for instance 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 on hv-cinder-81268 Jun 29 12:52:54.276863 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-83ec8892-06b1-42b3-9f4e-4523a426c13e req-7a4e66b8-2e4e-439d-983d-27f509518c6c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034042 Jun 29 12:52:54.277834 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 535/1046] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:52:54.282350 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-c718b93f-b9c0-4795-9845-7206fec28261 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0] Going to try to terminate instance {{(pid=124316) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 12:52:54.384975 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-c718b93f-b9c0-4795-9845-7206fec28261 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0" status: 204 len: 0 microversion: 2.1 time: 0.144160 Jun 29 12:52:54.386390 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 512/1047] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:52:54 2022] DELETE /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 12:52:54.395108 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-0699a33b-f054-4d43-8b60-ca89135370b1 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:52:54.395810 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-0699a33b-f054-4d43-8b60-ca89135370b1 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:52:54.402395 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0699a33b-f054-4d43-8b60-ca89135370b1 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:54.403587 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0699a33b-f054-4d43-8b60-ca89135370b1 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:54.404432 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0699a33b-f054-4d43-8b60-ca89135370b1 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:54.405085 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-0699a33b-f054-4d43-8b60-ca89135370b1 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:54.543313 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.policy [None req-0699a33b-f054-4d43-8b60-ca89135370b1 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124317) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:52:54.551075 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-0699a33b-f054-4d43-8b60-ca89135370b1 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0" status: 200 len: 1578 microversion: 2.1 time: 0.160311 Jun 29 12:52:54.551640 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 536/1048] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:52:54 2022] GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:52:55.569337 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-eebfb509-1e68-415f-a7c2-03e686c32124 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:52:55.570096 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-eebfb509-1e68-415f-a7c2-03e686c32124 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:52:55.576584 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eebfb509-1e68-415f-a7c2-03e686c32124 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:55.577036 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eebfb509-1e68-415f-a7c2-03e686c32124 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:55.577813 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eebfb509-1e68-415f-a7c2-03e686c32124 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:55.578253 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-eebfb509-1e68-415f-a7c2-03e686c32124 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:55.739370 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-eebfb509-1e68-415f-a7c2-03e686c32124 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:52:55.746894 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-eebfb509-1e68-415f-a7c2-03e686c32124 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0" status: 200 len: 1578 microversion: 2.1 time: 0.181798 Jun 29 12:52:55.747456 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 513/1049] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:52:55 2022] GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 => generated 1578 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:52:56.328036 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [req-bfad145a-96fc-411d-b0ed-a6bb001c0b99 req-a8ceb3a4-af8f-4793-9246-295113289ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0", "name": "network-vif-deleted", "tag": "5f4d9ef9-ce53-4c5e-9115-708ee3e03107"}]} {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 12:52:56.342054 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-bfad145a-96fc-411d-b0ed-a6bb001c0b99 req-a8ceb3a4-af8f-4793-9246-295113289ba3 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:56.342845 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [req-bfad145a-96fc-411d-b0ed-a6bb001c0b99 req-a8ceb3a4-af8f-4793-9246-295113289ba3 service nova] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:56.354525 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.compute.server_external_events [req-bfad145a-96fc-411d-b0ed-a6bb001c0b99 req-a8ceb3a4-af8f-4793-9246-295113289ba3 service nova] Creating event network-vif-deleted:5f4d9ef9-ce53-4c5e-9115-708ee3e03107 for instance 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 on hv-cinder-81268 Jun 29 12:52:56.359355 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [req-bfad145a-96fc-411d-b0ed-a6bb001c0b99 req-a8ceb3a4-af8f-4793-9246-295113289ba3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035067 Jun 29 12:52:56.359938 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 537/1050] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Jun 29 12:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 12:52:56.764156 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-5834436d-219b-4c06-9260-845af07cae7d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:52:56.764765 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-5834436d-219b-4c06-9260-845af07cae7d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:52:56.771232 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5834436d-219b-4c06-9260-845af07cae7d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:56.771625 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5834436d-219b-4c06-9260-845af07cae7d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:56.772377 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5834436d-219b-4c06-9260-845af07cae7d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:56.772811 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5834436d-219b-4c06-9260-845af07cae7d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:56.804638 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5834436d-219b-4c06-9260-845af07cae7d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:56.805964 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-5834436d-219b-4c06-9260-845af07cae7d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:56.806514 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.objects.instance [None req-5834436d-219b-4c06-9260-845af07cae7d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lazy-loading 'fault' on Instance uuid 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 {{(pid=124316) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 12:52:56.848861 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.policy [None req-5834436d-219b-4c06-9260-845af07cae7d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b08abc69fc8e46cea2831101e8d5db87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c3c5d6a04e74a23984b32760c5b1e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124316) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 12:52:56.857096 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-5834436d-219b-4c06-9260-845af07cae7d tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0" status: 200 len: 1229 microversion: 2.1 time: 0.096872 Jun 29 12:52:56.857894 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 514/1051] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:52:56 2022] GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 => generated 1229 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 12:52:57.875454 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-7faa213f-4372-43f0-9d4a-87ee43429e05 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:52:57.876156 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-7faa213f-4372-43f0-9d4a-87ee43429e05 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:52:57.882308 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7faa213f-4372-43f0-9d4a-87ee43429e05 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:57.882788 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7faa213f-4372-43f0-9d4a-87ee43429e05 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:57.883729 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7faa213f-4372-43f0-9d4a-87ee43429e05 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:57.884329 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-7faa213f-4372-43f0-9d4a-87ee43429e05 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:57.897204 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-7faa213f-4372-43f0-9d4a-87ee43429e05 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] HTTP exception thrown: Instance 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 could not be found. Jun 29 12:52:57.898882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-7faa213f-4372-43f0-9d4a-87ee43429e05 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Request method failure captured: Jun 29 12:52:57.898882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 HTTP/1.1 Jun 29 12:52:57.898882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:52:57.898882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:52:57.898882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:52:57.898882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:52:57.898882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:52:57.898882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:52:57.898882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:52:57.898882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:52:57.898882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEmkbmuk17l2hnGuWIasGTUauvZ1FDJ-rzWuFjKCy20tgkVCdORYXj4JNsIz6ubzAu6jaKRw97H3uUm06iybkSe-xi2Y6s4bPnFDU-hKVugVbNeapOAbMVbbNA9kAP1taoc0ZpT4IQuEldvzU3Ie4skurV5H8vjhs82Z0-P7Zavidkk Jun 29 12:52:57.898882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:52:57.898882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:52:57.898882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:52:57.898882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:52:57.898882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:52:57.898882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:52:57.898882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: 5c3c5d6a04e74a23984b32760c5b1e87 Jun 29 12:52:57.898882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-TestVolumeBootPattern-1219681393 Jun 29 12:52:57.898882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:52:57.898882 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:52:57.901200 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5c3c5d6a04e74a23984b32760c5b1e87", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5c3c5d6a04e74a23984b32760c5b1e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c3c5d6a04e74a23984b32760c5b1e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c3c5d6a04e74a23984b32760c5b1e87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:52:57.901200 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-TestVolumeBootPattern-1219681393 Jun 29 12:52:57.901200 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 5c3c5d6a04e74a23984b32760c5b1e87 Jun 29 12:52:57.901200 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-TestVolumeBootPattern-1219681393 Jun 29 12:52:57.901200 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-TestVolumeBootPattern-1219681393-project Jun 29 12:52:57.901200 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:52:57.901200 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:52:57.901200 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: b08abc69fc8e46cea2831101e8d5db87 Jun 29 12:52:57.901200 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-TestVolumeBootPattern-1219681393-project Jun 29 12:52:57.901200 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:52:57.901200 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Instance 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 could not be found. Jun 29 12:52:57.901200 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': '7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0'} Jun 29 12:52:57.902182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:52:57.902182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:52:57.902182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:52:57.902182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:52:57.902182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:52:57.902182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:52:57.902182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:52:57.902182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:52:57.902182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:52:57.902182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:52:57.902182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 could not be found. Jun 29 12:52:57.902182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:52:57.902182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:52:57.902182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:52:57.902182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:52:57.902182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:52:57.902182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:52:57.902182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:52:57.902182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:52:57.902182 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:52:57.904143 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:52:57.904143 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:52:57.904143 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:52:57.904143 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:52:57.904143 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:52:57.904143 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:52:57.904143 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:52:57.904143 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 could not be found. Jun 29 12:52:57.904143 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:52:57.904143 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:52:57.904143 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:52:57.904143 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:52:57.904143 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:52:57.904143 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:52:57.904143 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:52:57.904143 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:52:57.904143 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 could not be found. Jun 29 12:52:57.904143 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:52:57.905593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-7faa213f-4372-43f0-9d4a-87ee43429e05 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Returning 404 to user: Instance 7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:52:57.905593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-7faa213f-4372-43f0-9d4a-87ee43429e05 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0" status: 404 len: 111 microversion: 2.1 time: 0.030287 Jun 29 12:52:57.905593 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 538/1052] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:52:57 2022] GET /compute/v2.1/servers/7ca41af5-5bcf-4bcb-a2ef-0a8cda0220c0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:52:58.348807 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-13eef944-93ff-4eac-b484-49b52584d6b5 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:52:58.349332 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.compute.api [None req-13eef944-93ff-4eac-b484-49b52584d6b5 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 2e36e163-5fb2-427e-90e6-5ceb3913a184] Fetching instance by UUID {{(pid=124316) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:52:58.355881 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-13eef944-93ff-4eac-b484-49b52584d6b5 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:58.356354 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-13eef944-93ff-4eac-b484-49b52584d6b5 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:58.357142 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-13eef944-93ff-4eac-b484-49b52584d6b5 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:58.357543 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG oslo_concurrency.lockutils [None req-13eef944-93ff-4eac-b484-49b52584d6b5 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124316) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:58.374079 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.wsgi [None req-13eef944-93ff-4eac-b484-49b52584d6b5 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] HTTP exception thrown: Instance 2e36e163-5fb2-427e-90e6-5ceb3913a184 could not be found. Jun 29 12:52:58.375774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-13eef944-93ff-4eac-b484-49b52584d6b5 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Request method failure captured: Jun 29 12:52:58.375774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: request: DELETE /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184 HTTP/1.1 Jun 29 12:52:58.375774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept: application/json Jun 29 12:52:58.375774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Accept-Encoding: identity Jun 29 12:52:58.375774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Connection: close Jun 29 12:52:58.375774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Length: 0 Jun 29 12:52:58.375774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Content-Type: application/json Jun 29 12:52:58.375774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Host: 10.222.0.52 Jun 29 12:52:58.375774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Openstack-System-Scope: None Jun 29 12:52:58.375774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: User-Agent: python-urllib3/1.26.9 Jun 29 12:52:58.375774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Auth-Token: gAAAAABivEmkbmuk17l2hnGuWIasGTUauvZ1FDJ-rzWuFjKCy20tgkVCdORYXj4JNsIz6ubzAu6jaKRw97H3uUm06iybkSe-xi2Y6s4bPnFDU-hKVugVbNeapOAbMVbbNA9kAP1taoc0ZpT4IQuEldvzU3Ie4skurV5H8vjhs82Z0-P7Zavidkk Jun 29 12:52:58.375774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Id: None Jun 29 12:52:58.375774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Domain-Name: None Jun 29 12:52:58.375774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Identity-Status: Confirmed Jun 29 12:52:58.375774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Is-Admin-Project: True Jun 29 12:52:58.375774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Id: default Jun 29 12:52:58.375774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Domain-Name: Default Jun 29 12:52:58.375774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Id: 5c3c5d6a04e74a23984b32760c5b1e87 Jun 29 12:52:58.375774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Project-Name: tempest-TestVolumeBootPattern-1219681393 Jun 29 12:52:58.375774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Role: member,reader Jun 29 12:52:58.375774 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Roles: member,reader Jun 29 12:52:58.377502 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5c3c5d6a04e74a23984b32760c5b1e87", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5c3c5d6a04e74a23984b32760c5b1e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c3c5d6a04e74a23984b32760c5b1e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c3c5d6a04e74a23984b32760c5b1e87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:52:58.377502 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant: tempest-TestVolumeBootPattern-1219681393 Jun 29 12:52:58.377502 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Id: 5c3c5d6a04e74a23984b32760c5b1e87 Jun 29 12:52:58.377502 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-Tenant-Name: tempest-TestVolumeBootPattern-1219681393 Jun 29 12:52:58.377502 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User: tempest-TestVolumeBootPattern-1219681393-project Jun 29 12:52:58.377502 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Id: default Jun 29 12:52:58.377502 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Domain-Name: Default Jun 29 12:52:58.377502 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Id: b08abc69fc8e46cea2831101e8d5db87 Jun 29 12:52:58.377502 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: X-User-Name: tempest-TestVolumeBootPattern-1219681393-project Jun 29 12:52:58.377502 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: method: > Jun 29 12:52:58.377502 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: exception: Instance 2e36e163-5fb2-427e-90e6-5ceb3913a184 could not be found. Jun 29 12:52:58.377502 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: action_args: {'id': '2e36e163-5fb2-427e-90e6-5ceb3913a184'} Jun 29 12:52:58.378372 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:52:58.378372 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:52:58.378372 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:52:58.378372 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:52:58.378372 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:52:58.378372 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:52:58.378372 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:52:58.378372 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:52:58.378372 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:52:58.378372 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:52:58.378372 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e36e163-5fb2-427e-90e6-5ceb3913a184 could not be found. Jun 29 12:52:58.378372 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:52:58.378372 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:52:58.378372 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:52:58.378372 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:52:58.378372 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:52:58.378372 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:52:58.378372 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:52:58.378372 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:52:58.378372 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:52:58.379738 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:52:58.379738 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 12:52:58.379738 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 12:52:58.379738 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 12:52:58.379738 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 12:52:58.379738 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:52:58.379738 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:52:58.379738 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:52:58.379738 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:52:58.379738 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e36e163-5fb2-427e-90e6-5ceb3913a184 could not be found. Jun 29 12:52:58.379738 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:52:58.379738 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:52:58.379738 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:52:58.379738 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:52:58.379738 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:52:58.379738 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:52:58.379738 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:52:58.379738 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:52:58.379738 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e36e163-5fb2-427e-90e6-5ceb3913a184 could not be found. Jun 29 12:52:58.379738 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: ERROR nova.api.openstack.wsgi Jun 29 12:52:58.381109 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-13eef944-93ff-4eac-b484-49b52584d6b5 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Returning 404 to user: Instance 2e36e163-5fb2-427e-90e6-5ceb3913a184 could not be found. {{(pid=124316) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:52:58.381109 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-13eef944-93ff-4eac-b484-49b52584d6b5 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184" status: 404 len: 111 microversion: 2.1 time: 0.032274 Jun 29 12:52:58.381109 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 515/1053] 10.222.0.52 () {58 vars in 1238 bytes} [Wed Jun 29 12:52:58 2022] DELETE /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:52:58.386631 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-2e33ea74-9765-4677-ba3c-d5eecc93a491 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '>' {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:52:58.387233 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.compute.api [None req-2e33ea74-9765-4677-ba3c-d5eecc93a491 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] [instance: 2e36e163-5fb2-427e-90e6-5ceb3913a184] Fetching instance by UUID {{(pid=124317) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 12:52:58.393109 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2e33ea74-9765-4677-ba3c-d5eecc93a491 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:58.393554 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2e33ea74-9765-4677-ba3c-d5eecc93a491 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:58.394304 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2e33ea74-9765-4677-ba3c-d5eecc93a491 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 12:52:58.394813 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG oslo_concurrency.lockutils [None req-2e33ea74-9765-4677-ba3c-d5eecc93a491 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Lock "644b0361-1506-422f-bdf1-8cea2d80e866" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 12:52:58.408315 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.wsgi [None req-2e33ea74-9765-4677-ba3c-d5eecc93a491 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] HTTP exception thrown: Instance 2e36e163-5fb2-427e-90e6-5ceb3913a184 could not be found. Jun 29 12:52:58.409844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-2e33ea74-9765-4677-ba3c-d5eecc93a491 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Request method failure captured: Jun 29 12:52:58.409844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: request: GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184 HTTP/1.1 Jun 29 12:52:58.409844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept: application/json Jun 29 12:52:58.409844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Accept-Encoding: identity Jun 29 12:52:58.409844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Connection: close Jun 29 12:52:58.409844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Length: 0 Jun 29 12:52:58.409844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Content-Type: application/json Jun 29 12:52:58.409844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Host: 10.222.0.52 Jun 29 12:52:58.409844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Openstack-System-Scope: None Jun 29 12:52:58.409844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: User-Agent: python-urllib3/1.26.9 Jun 29 12:52:58.409844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Auth-Token: gAAAAABivEmkbmuk17l2hnGuWIasGTUauvZ1FDJ-rzWuFjKCy20tgkVCdORYXj4JNsIz6ubzAu6jaKRw97H3uUm06iybkSe-xi2Y6s4bPnFDU-hKVugVbNeapOAbMVbbNA9kAP1taoc0ZpT4IQuEldvzU3Ie4skurV5H8vjhs82Z0-P7Zavidkk Jun 29 12:52:58.409844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Id: None Jun 29 12:52:58.409844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Domain-Name: None Jun 29 12:52:58.409844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Identity-Status: Confirmed Jun 29 12:52:58.409844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Is-Admin-Project: True Jun 29 12:52:58.409844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Id: default Jun 29 12:52:58.409844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Domain-Name: Default Jun 29 12:52:58.409844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Id: 5c3c5d6a04e74a23984b32760c5b1e87 Jun 29 12:52:58.409844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Project-Name: tempest-TestVolumeBootPattern-1219681393 Jun 29 12:52:58.409844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Role: member,reader Jun 29 12:52:58.409844 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Roles: member,reader Jun 29 12:52:58.411614 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5c3c5d6a04e74a23984b32760c5b1e87", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5c3c5d6a04e74a23984b32760c5b1e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c3c5d6a04e74a23984b32760c5b1e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c3c5d6a04e74a23984b32760c5b1e87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jun 29 12:52:58.411614 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant: tempest-TestVolumeBootPattern-1219681393 Jun 29 12:52:58.411614 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Id: 5c3c5d6a04e74a23984b32760c5b1e87 Jun 29 12:52:58.411614 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-Tenant-Name: tempest-TestVolumeBootPattern-1219681393 Jun 29 12:52:58.411614 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User: tempest-TestVolumeBootPattern-1219681393-project Jun 29 12:52:58.411614 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Id: default Jun 29 12:52:58.411614 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Domain-Name: Default Jun 29 12:52:58.411614 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Id: b08abc69fc8e46cea2831101e8d5db87 Jun 29 12:52:58.411614 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: X-User-Name: tempest-TestVolumeBootPattern-1219681393-project Jun 29 12:52:58.411614 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: method: > Jun 29 12:52:58.411614 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: exception: Instance 2e36e163-5fb2-427e-90e6-5ceb3913a184 could not be found. Jun 29 12:52:58.411614 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: action_args: {'id': '2e36e163-5fb2-427e-90e6-5ceb3913a184'} Jun 29 12:52:58.412583 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: {{(pid=124317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 12:52:58.412583 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:52:58.412583 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 12:52:58.412583 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 12:52:58.412583 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 12:52:58.412583 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 12:52:58.412583 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 12:52:58.412583 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 12:52:58.412583 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 12:52:58.412583 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 12:52:58.412583 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e36e163-5fb2-427e-90e6-5ceb3913a184 could not be found. Jun 29 12:52:58.412583 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:52:58.412583 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:52:58.412583 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:52:58.412583 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:52:58.412583 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:52:58.412583 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:52:58.412583 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 12:52:58.412583 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 12:52:58.412583 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 12:52:58.414148 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 12:52:58.414148 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 12:52:58.414148 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 12:52:58.414148 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 12:52:58.414148 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 12:52:58.414148 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 12:52:58.414148 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 12:52:58.414148 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e36e163-5fb2-427e-90e6-5ceb3913a184 could not be found. Jun 29 12:52:58.414148 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:52:58.414148 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 12:52:58.414148 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:52:58.414148 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 12:52:58.414148 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 12:52:58.414148 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 12:52:58.414148 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 12:52:58.414148 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 12:52:58.414148 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e36e163-5fb2-427e-90e6-5ceb3913a184 could not be found. Jun 29 12:52:58.414148 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: ERROR nova.api.openstack.wsgi Jun 29 12:52:58.415795 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: DEBUG nova.api.openstack.wsgi [None req-2e33ea74-9765-4677-ba3c-d5eecc93a491 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Returning 404 to user: Instance 2e36e163-5fb2-427e-90e6-5ceb3913a184 could not be found. {{(pid=124317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 12:52:58.415795 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO nova.api.openstack.requestlog [None req-2e33ea74-9765-4677-ba3c-d5eecc93a491 tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184" status: 404 len: 111 microversion: 2.1 time: 0.029232 Jun 29 12:52:58.415795 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: [pid: 124317|app: 0|req: 539/1054] 10.222.0.52 () {58 vars in 1235 bytes} [Wed Jun 29 12:52:58 2022] GET /compute/v2.1/servers/2e36e163-5fb2-427e-90e6-5ceb3913a184 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 12:52:59.701668 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: DEBUG nova.api.openstack.wsgi [None req-cead4cea-2358-4add-a320-f3556f6afcac tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] Calling method '.version_select at 0x7fdb06ab3160>' {{(pid=124316) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 12:52:59.724047 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO nova.api.openstack.requestlog [None req-cead4cea-2358-4add-a320-f3556f6afcac tempest-TestVolumeBootPattern-1219681393 tempest-TestVolumeBootPattern-1219681393-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-260463289" status: 202 len: 0 microversion: 2.1 time: 0.026138 Jun 29 12:52:59.724648 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: [pid: 124316|app: 0|req: 516/1055] 10.222.0.52 () {58 vars in 1259 bytes} [Wed Jun 29 12:52:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-260463289 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 12:55:03.686916 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 12:55:03.687525 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Wed Jun 29 12:55:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 12:55:13.890133 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 12:55:13.890824 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Wed Jun 29 12:55:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 12:55:30.332380 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 12:55:30.333010 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Wed Jun 29 12:55:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 12:55:39.935289 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 12:55:39.936453 dv-cinder-812685-12-iscsi devstack@n-api.service[124317]: Wed Jun 29 12:55:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 12:56:54.326731 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 12:56:54.327313 dv-cinder-812685-12-iscsi devstack@n-api.service[124316]: Wed Jun 29 12:56:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!